BD 165 797^ 



r 



IB 0O6 



AUTHOR * 
TP^ETLE 

ISSl*ITUTlOH 

report so ' ' 
, pub'datb 

COSTRftCT ^ \ 
NOTE ^ 



EDRS PRICE 
DESCRIPTORS 



IDEHTIFIERS 



ABSTRACT 



John Seely 

Aid tor a natural 



Language 



Burton, Richard R. ; Broyn, 
Intelligent CAI: An Author 
Interface, , \ 

Bolt^ Beranek and Newmanr Itic. r Caabridge/ Mass. 
Advanceja Research Projects Agency (DOD) , Kast^iDgton, 



BBH-3913; ICAI^I^ 
Aug 78 

«DA-903-76-C-0108^ 
63p, For telated 

:205 

«F-$0,83 EiC*$?,"50 Plus Postage,, 
Coiflputa^ti onal. Linguistic^; ^tont^uater Assisted 
Instructi9n; *C omputer oriented Prog r a as; *Coiflputer 
ScienOe Education; Military Training; Technical 
Writing . 
♦Natural Language 



documents^ see ED 114 089 and 13^^ 



{ 



Thi3 Report; a<}dresses the problems of" using hatural 
language (English/ as, the cortfflunixration language for advance^d 
computer-based instrufct idn^l ^y^stews. The instructional environment 
places requirements on a natural language understanding systeia that 
exceed the capabilities of alKexisting^ systeas, including: (1) 
efficiency, (2i habitability , ^{3V tutorial capability and the 
ability to exist with ambiguity. Semantic gcaminar is presented as a 
paradigm fpr organizing ;the knpwledge^ required in the' , understanding ^ 
process that permits efficient handlings of such phenomena as 
pronominalisations and ellipses. The nee^^for a better formalism for 
e.xpressing semantic gif^mmars is met by the'us^ of Augmented 
Transit?.on Networks (ATN) • The ability of the ATS--expressed" semantic 
grajimar to satisfy the "mentioned requirements is 'demonstj^ated in the 
natural langua-ge front-end for the ^SOPfUE system, (Author/JEG) 



* Reproductions supplied by EDRS are the best that can b^ made * 

* / ^ ,from the 9riginal" document, * 



Bolt Beranek and Newman Inc. 



BBNtKport No. 3913 
ICAI Report No. 11, 



/ 



U 5 OEf AftTMENTOF HEALTH 
EDUCATION ftWELFARE 
HAT*OHAL IHSTlTUTC O" 
EDUCATtON 

THIS (XJCUweiM ^ MAS BEEN nefRo- 'I 

oucEO exactlv as received from 

THE PEBSON OR OSGANiiATlOiMORlOlH , 
AriNO'iT POINTS Of VIEW Oft OPINIONS ^ 
S'ATEO 00 NOT NECE^SSARlLV BEPRE 
SENT OFFICIAL NATIONAL iN^TlTUtE 0^ 
EDUCATION POSITION Off POlKT 



r 



Intelligent CAl: An Author Aid for a Natural Language Interface 

RichardlR. Burton and John Seely Brown 



/ ' 



August 1978. 



-7^ 



To ^appear^ in: 



Harojd F,. O'Neil (Ed.) Instructional System Development 
Academic Press, New York, 1979 



INTELLIGENT CAI; 
AN AUTHOR AID FOR A NATURAL LANGUAGE INTERFACE. 



Richard R. Burton and Jt5hn Seety Brovn 



August 1978 



D 



This res^earch was supported in part by the Advanced Research Projects Agency, 
Air Force Human Resources La|>DratDryt Army Pfesearch Institute for Behavioral 
and gocial' Sciences, and Navy Personnel R^earch and Development Center under 
Contract-4jo. KDA903-76-C-0108. 

The views "-and conclusioas contained in this document are those of the authors 
md should* Dot be interpreted as necessarily representing the official policies 

either expr^asec^'^or implied,, of the U.S. Government* 

^ * *t * ' + * 

Portions of .ttii^ report are'a revised and updated version of ^ICAI //3. 



UNCLASSIFIED " ^ ' , ' 


" REPORT D0CUMENTATlO>rPAGE * 


Hh.M) 1\sl Ml 1 I1ii\^ 

in \ 1 i>\)ri T H\f. i < \\\\\ 


B!iN Rejlort ,'/39J3 " 


^' 


intelligent CAT: An Author Aid for a Matural 
Language In c erf ace 


Ty*ic OF ticpORT A h''ni(00 covrfHi-'j 

Technical Report" . 




Ri<;hard R. Burtop and ^ John Seely 'Brown 


1 

MDA90J-76-C^010^ ' ' ^ . 


f^F^RcORwlMO 0R<> aVj( Z aT ( 0*^-'M am F amO A^OOr E<i5 , 

Bolt Ber^^iek and Newman Inc 
50 Moulton Street 

Cambridge, HA 02138 y ' * ^ 


lO. P ROG n AM K L Cub N TPrOJECT Taji^ 
aREa & AOfilK UmH MUl^GERS 


1 1 COpsfT u use; OpFi^f. HAwb AK,c> Ad^n F si 

Defehse. Advanced Research Projects Agency 

1400 Wi-lson "Boulevard . t . 

Arlingtoti, VA 22209 ^ ' 


\t I^^T Date 

August 1978 ' ^ 


50 


Navy Personnel Research and Development Center / 
San Diego, ' 92152 , . 

• J ■ • . . . - 


1^ SECURITY Class ihi^ 'rpttrtj 
' t 


-liO. DtZC'w ASStF ( C AT lO^ ■' OOvy^N Gff A rjiN^ 

SCKeCJUL,E 


• r ■ ' 

* t 


-^Approved for public release; distribution unlimited 

i - " * 


This research was supported in part by the Advanced Research Projects Agency, 
Air Force Human Resources Laboratory, Army Resea^rth Institjuce^f or-BehavioVal 
and Social Sciences, and Navjr Personnel Resear<ch and Development Center. 


Authoring aids, natural language systems , semantic grammar, augmente<d 
transition networks, intelligent CAI. ' ' * ^ 

s ^ ■ ■ , 


A© S r n aC T (Cont.nu^ on rftf/ if ndf if ncfc ^ iar^^ and tdfritify by block numtffJ - ■ " 

J)t\<x o( Che major stumbling blocks for. an irjcelligent ins'tructronal system is 
^ the l^c'k of a natural means of communication between the student. and; che^ 
computerA This report addresses t^jie problems of using natural language 
(English) a^ the communication language for advanced computer-based* 
instructioiia|l systems. Th^ instructional environment places requirements 
on ^ natural^^ language understanding system that exceed the capabilities of 
all existing systems. These requirements include: (1) efficiency " 


DD .T*^^^ ^ 1473 eO^T^OM OP I MOV 6S IS OOSOLeT E ■ ^ . 

i : ■ 



SeCU'liT r CL ASSlPiC *T ION Of THIS P ACe ffl^^n Vniii f nr, r* di" 

\ 



(2) habitability (3) tutorial capability and (A) the ability to exist witji 
ambiguity* The notion of semantic gtamttiar' is presented as a paradigm for 
organizin;^ the knowledge required in the' understanding process that permits 
efficient parsing/ ^n ad(fition, semantic grammar aids the habitability ^ 
^by providing insights into a useful class of dialogue constructs^ and 
permits efficient han<^ling: of such phenomena as pronominalizations and 
ellipses. The^need for a better formalism for expressing semantic graimnars 



is met by the use of Augmented Transition Networks (ATN) . The ability of the 
ATN-expressed semantic grammar to satisfy the Vabove' Stated requi^jements Is 
demonstrated In the natural language front-end' for the SOPHIE system. ^ 




s 



SeCifRlTr CLASsif aTIOM OF j^t^ P AQ^(Uhtn Data Entered} 



TABLE OF CONTENTS 



SECTION 1 REQUIREMENTS FOR A NAJU-BAL LANG.UAGE INTERFACE FOR 
INSTRUCTIONAL SYSTEMS * 



Requireiient s .\ . . 

SECTION 2 - SAMPLE DIALOGUE. 



SECTION 3 - SEMANTIC GR AHHAR. . 1 \, 

IntP'^dirction ' 

Representation of Meaning , : • . 

Result of the Parsing \ 

Us^e of^Sedantic Information during Parsing t 

> Prediction * * ^ 

Simple Deletion \\ / ; 

Ellipsis : 

Using Context to Determine Referents. 

Pronouns and Delet ions y 

Referents for El lipses 

Limitations of the Context Heohanism 

Fuzziness ^ 

Preprocessing \ 

Implementation \ \ * 



SECTION i* - A ITEW formalism - SEMANTIC AUGMENTED 
-TRANSITION NETWORKS : 



Augmented Trajisition Networks 
Advantages of ATN Formalism 
Conversion to^ Semantic A;rNs 

Fiizzine'ss 

Comparison of Results 



SECTION 5 - OBSERVATIONS ON STUDENT USAGE 

Impressions J Experiences and Observations 
Feedback - When the Grammar Fails 

SECTION 6 - CONCLUDING DISCUSSION 



Future Research^ Areas 

Conclusions 



References 



Intelligent Ckl: 

^ An Author Aid for *a Natural Language Interface 
* * ■ * 

Richard Burton' and John Seely Brown 

, BoltBeraneicand Newman Inc. 

Cambridge, Massachusetts 



SECTION 1 



This^^is a^period of dramatic advanced in computer technologyiwh-ich 
'Should change, the way computers are employed in instruction 



advances will decrease 



Techno logical 

the^ cost of computer tiardware to the extent that 



:l?mi 



aids needed 



to ^facilitate 



e f f Ic ien t 



each student" will have available c^mpu1:atioriaI r esou rce 3 which * are 

currently restricted to a few^elite us^rs, Traditi'onal compute?- assisted. 

instruction (CAl) paradigms wece developed und^ r the assumption that 

computational power hIs. a scarce resource/ and t>hese/ paradigms are., for the 

'most part, incapable cf exploiting the latest technological advances. To 

effectiv_ely use the increased "<iaPiputatianal powjfr requires^ a re- e vSluat ion 

of the role of, the computer in ins truo t ional paradigms, and, i|n turn, a 

be-evaluation^ jyf the authoring 

deveIopment\ in this mediunr. 

The^ type of instructional system wlilch we see em^e rgi ng_^ > ha ve specifi'c 

knowledge and problem-solving expertise which is used tp^aid :the s t ud en t + 

First, as a source of information, It can^answer h^ vques t ions , Bval ua t e 

his theories and cr i t^qu'e his^ solutHLpn paths.. ^ Second, a^ a tutorial' 

mechanis^, it can form model s of it>oth the student's state of knowledge and 

his reasoning strategies. These structural model?'* are used bo'th to 

ident^ify his fundamental misconceptions and to ^de-termlne when and' how to 

* * 
pro vide remediation, ^heuristic rlscommendations {^'hints"), or further* 

instruction* ^ ^ : 

In general, we are not focusing on techniques-: for, , teachi'ng factual , ^ 

t ex t book ' knowledge CAI" systems which do not^u:se their knowle<lge they 

contain (as a textbook, does not use the knowledge it con tains) ^an 

competently handle this't^sk and are inherently cheaper for it, * Ins^tead, 

focusitig on techniques, for teaching ^ ora^dural ' kn-^^lecjpe ands 

.ng st rategies which are I'earned when the stu'dent must' use his 



we are 
reagonli 
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factual knowledge in hands-on laboratory or p rob lem- sol v ing tasks/ While 

the student is " getting a oha*no^e *to exercise his knowledge, the 

"rntelligent" instrilotioOal systems which we a re considering here attempt 

to mimic the capabilities of a laboratory instructorft. The system works on' 

a one-to-one basis wtth a student, carefully diagnosing whdt *the stud en t 

knows^, how ^he or* she reasons, and wha,t kinds of deficiencies exist in his 

or he^ ability to apply factual knowledge* The system then -uses this 

inferred*^ knowledge of the student tog'eth^er witii its know^ed^e of pedagogy 

to determine hoV best" to advance "tt^e stu dent's learning.^ 

^* 

' Whil-e we are still a lorig way from attaining' this" goal, we^ have 
deve^ped en organi za t ion^ for iijjtelligent instructional systems, ^described 
in Brown . [ 1 977 ]).,_ which appears fruitful. 'Our methodology f or ev elop ing 
t hi s ^organiza ti^on (and tile theory underlying^it),bas been to^' explore parts 
of the overall" organization in '''paradigmatic*^ systems. k paradigmatic 
system is an easily modified 'prototype system 'constructed over a carefully 
chosen doma in o-T knowledge. This methodology allow^ experii&^ntation with 
some aspect of the'overall system by simplifying other aspects. We 



have 
\ 



developed systems fpr s\TQh 'domains, as elect ronic troubleshooting'-- ^OPH^E 
[BVown^ * BOrton ^nd ©ell 1 975 ;_ Bnjown , Rubinstein and Burton ' 1976 1 ? 
arithmetic ^ drill and practice WEST [Burton and Brown 1 976, 1 978J> 

elementary algebra [Brown, *et al. ,1975]; — ^^Ji d -p rocedural skill s in 
Arithmetic *- BUGGY ["ferown" ' and , Burton 1 9/8] . Irt- addition, systems of 
similarjfcspirit are being developed Gblda^tein [Carr and Goldstein 1 977 ]- 
One of the major 3tu<Dbling blo<;ks for ag intelligent instructional 
system is the lack- of a, natural means' of ^ communication between the student 
and the comPute^r* This ^ chapter addresses ttie problems of using natural * 
language (English) as the^ communication language for . advanced - 
computet' -based instructional sy3tems>'T,he instructional environment ^places 
requireiaents oTT a- n^t^ral language uncf^er standing system that exceed the ^ 
capabilities c>f all ^xistilrtg systems* These requirements ijiclude: ' (l) 
efflcienci^^ {2) habitability ( 3 ), l^utor ial| capabll i t y and (i*) the ability to ^ 
exist with amtriguity. However, there arejmatJor leverage points within th^ 
ins true ti onal environment that allows thes§ requirements to^e met*,' J[n_the- 
next section* we' will elaborate jjjj^these Requirements-, 
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i^nstrgction^l si t'u a^on , 



REQti"lREMSHTS ' ^ ' ' , ' " 

A prifflary requirement '^or a natural language process so r*, in an 

isj efficiency. 'Imagine the^^ following ^3 etting: 
the student is^ at a 'terminal activejy_ workings on a -problem. He/She deci.deg 
that he/she ^needs another piece of* information to advance his/her^ solution, 
so he/she formulates'a'query. Once he/she. has finished typing his/her 
question, , he / she "^wi 1 1 wait for the systefti to give him/"her an answer before 
h^/she continue3.--«T5r"king on his/her solution. .During the time 'it takes the 
system, to understand his/her query and generate an answer, the student is- 
apt to ' forget p^r.tinerjti , li^formation and l£>se ■intere'st/ Psychological 
expeptments have shown that resfronse dejays longer .than . two "seconds have 
serious effects on the per for romance of complex tajsks via terminals (Miller^ 
68 ) In thest two seconds, the system must understand the query; deduce, 
I'nf^a, lookup or calculate the answer; and generate a response. Another. 

poor response time is that more o.f ^the students 



adverse effect of 

searching fpr the answer^ ts done internalljr^^{ij,e. withowt using the 
system). This decreases the amount ot in formation ■ the tutoring system' 
r ec e i ves^^ and increase;5 the amount of induction that must b,e pe^pf o rme d , 
making the prob*^em of figuring out What th^ student is" doing much harder 
(e.g, the student won't "show his work'* when solving a problem; he uill 
just present th^answer). . 

The second^ require m_^nt for" a natura]^ langtfage processor is 
ha-bJLtabj,litv / Any natural language syst.era written in the foreseeable 
future is not going to be able to understand all of natural language. What 
a, good natural^ language interface- must do ,is cJiaracterize and understand a 
.usab,le su6^e t of the language . Wa tt ( 1 968 p\ 338 ) defines $ V'habi table" 
sub-language 'as *'one- in whioh its users can expres^s themselves without 
stra'yin^ over- the language J}oundaries info unallowed sentences**. Vary 
intuitively, for a system to *be habitable it^ must, ^ among other things--, 

* * ^ * * t 

allow the user to makfe local or ml^^no-r modifications to an accepted sentence 
and get another accepted sentence. Exactly how much mo^dificatibn 



cons"tltu,t4s a' minor, cHange has never bee;n specified 
provicte more insight ijito this notien. 



Some examples mav 



{ 1 ) Is ^any*:hing wrong? 
(2) Is there anything wrong? 
f37. Is there something wron^? 
{4r Is there anything wrong >ith section 3? 
(5) Does it look to you like 



you like section 3 could have a. problem? 




If' a natural language processor accepts sentence '.1,*it should also accep^ 
the mod ifioations given in sentence 2. and 3* Sentetice 4 presents a 
syntactic extension which may have major repercu^ions in the semantics but 
which should also be a^xje p t ed . Sen te nee 5 is an ex ample of a po9sibl$ 
paraphrase * of sentence 4 which is beyond the intended notioo ^ of 
h'ab itability* Based bn the acceptance of sentences 1^4, the user has no. 
reSson expect that sentJ&nce 5 willKbe^ handled. - ) | 

Any sub- language whic^h does not maintain a high degre^ of^habitability 
is apt^^^t^>-y^be worse than no^natur^l language capab i 1 i ty all*. Because^ in 
addition to the problem he/^he is seeking ^information about, tha student is 
fap^ed, sporadically, with tTie problem of get'ting the syste* to understand 
/her query. This second problem ^an be digastrOTts both because t 



hi s J 



oV^c ur s se em inglV^ at random and because it is ill-defii 

In an informal experiment to test the habi*tab rl i ty of a system, ' tjie 
authors^ asked a grouTp^ of f Qu r s tu dent s to writ e ^ down as many ways ajs 
possib 1 e o^aski ng a particular' question. The original idea w1a*s >co 
determine how "many of ttie various paraphrasing*- would be accepted by the 
prototype system;^ we werre testing, *Th^ students' each came up^ with one 
phrasing very quickly but had tremendous diff^ulty thinkfh^ of any othe^rs, 
ew»n thqugh'thi?ee of^ the first phr&sings were different! Jl^is experi en\e 
demonstrates the lack (if' student's ability to ^ do "linguistic** 'problei 
solving and ^ointa out^ the i^n^jortance of acc e ptr^^g the s tud en f i rsJ 
phrasing. . ^ - y 

An equally important aspect' of the ^abitabili tyf i problem * is 
mul ti-sentenc^ \(or dialogue) phenomena. When st^udents use, a system that 
exhibits "intelligence** through its inference capabi they qui-ckly 

start *'to assume that 'the system must also 6e int^lligerft ,in *its 
conversational 'abilities Sa' wellJ For example, they will reqUt^n 1 1 y delete 
pa^s of their statements whicti they feel are obvious, given the context of 
the pre^ ed i n^ statements.. Often they ^are tot all y unaware of such, deletions 
and show surprise' and/or anger when .the 'system fails to utilize contextual 

\ 
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information as clearly as they ( subconeoiously) do. The use of c^onj^ext 
manifests i tsVl f in ^the use of such linguistic 
pronominalizations, * anaphoric deletions and^ e-lltpses. 
sequence of que s-t ions' 6-xempl*rTles\these problems; 



phenomena as 
I 

The ^^llowing 



(6) What is the popjblation of Los Angeles? 
(7^ What is it for ^an Francisco? 
^>(8) What ^about San Diego? 



" * Tiie third requirement for a natural language process^or is that^ it be 

sel f- tutoring (i,e., that it should teach *the student* about its 

capabilities) As the student use's the system, he should begin tp feel' the ^ 

range and limitations of the sub-language. When the student uses a 

sentreOce that.the system can't understand, 'tie should receive feedj^ack that 

will enable htm, to determine'why it can't. There are at least two kinds of 

feedback, f^The simplest (and most often seen) merely .^provides some 

* - ^ , ^. ■ 

indication of wh#t parts of the sentence caused the problem (e.g, unknown 
ft 

^word or phrase). A* more useful kind of feedback goes on-to provide a 

— . '* - 

response based on those parts of the sentence that did make sense and then 

indicate Cor give examples of) possibly related, acceptable sentences. Jt 

mav even be advantageous to t\ave hhe system recognize' common un acc eptabi e 

*seR^nces and In response to them, explain why .they are not * in the 

sub-language. (See Section 5 -Por -further discussion of'thi's point,) 

The^fourth reqifirement Voir a natfral language system is that^ it be 

aw*are cyf ' ambiguity . Natural language gains a good deal^of flexibility and 

powe^r b^not forcing every meanipg ^intTo a |different surface structu>*e- 

This means that " the trogr^m that interprets natural language sentence's 

must be aware that more t^han one inter J>re tat ion is* possible. For example, 

whe n aske d : ^ . , ^ ' ' _ 

(9) Was Jahn believed to have been shot by Fred? 

one of the most potS'ntially disastrous^responses is *'Y6s". ffhe, user may - 

not be sur^ whether Fred the sho'oting ar the believing or bo^th. ^More 

likely,., the us^er,, being unaware of any ambiguity, assumes an interpretation 

that mav uC'^f f eren t than the system's. If, the system *s interpretation isN 

differ^ent, the user thinks he has receiv,ed the 'answer to his qu^ry when in 

fact he has' received the, answer to a completely Independent query* 

/.. . ■. - .■ 



Elther^of the following is k much better response 

(10) Yes, -it is believed tfftt Fred ?ho^ John 

(11) Ye3, Fred believes* t ha John was shot^ 



The sVst^m need not necessarily have tremendous disambiguation skills, but 
it ,.niust ^e aware that mi s- i nt er p r;et a t i on s are possible and inform the* u^t^ 
of its interpretation. In those cases where the system makes a mlstalce the 
re suite's may be aijnoying but shoald not b,e catastyphic. 

^ This chap.t^r presents the development of a techjsique ^that we have 
named **semantic grammars'* foK^ building natural language pr&cessors that 
satisfy the above rec^uirements . Section 2 presents a - di^alogue ^ from the 
*' intellt geri^ CAI system SOPHIE, lhat we used to refine and demonstrate, 
this techniqu,er\This di.af'logue provides concrete examples of the^. kin^ds of 
linguistic c^pa bi 1 i t i^st^ that oan be achieved using sema^t ic grammars. 
Sec t ion 3 de S'Crlbes"' seman t ic grammar as it first evolv^.d i^ SOPHIE, and^ 
points out how it allows semantic information tp be used Jto handle' dialogue 
constructs, and to allow *the' directed ^^gn or ing of words in the^input 
Section 4 discusses the limitations that were encountered 'iji the evolution 
of semantic grammars in S^PHIE-as t^he range of? sentences was increased an^l 
.how these might' be overc(#fee by using a different formalism augment 
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sm 
3- 



trans itioFi networks ( ATM ). Section 4 a4so reports on: the conversion of 

SOPHIE semantic grammar to an ATN^^and the extensions to the ATN Tgrmali 

^ " ' 1r ' . 

which were necessary to maintain*the solutions presented in Section 

r ^ ' " * r ' 

Section 4 also Inc Ijjdes comparison timings bet we en the two versions of the** 

natural language processo-r.. Section 5 describes experiertcTs we have had 

with SOPHIE, and presents techniques, developed to handle problems in tffe 

area of non-understood sentences.. 'Section 6' suggests d i ret; t ions for future' 

wo r k • . 
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Sectionv2^.^ 

Before delving into t^e structura-1 aspects and technical details of 
wtie s em antic grammar td"chnique, we.would first like to provide a concrete 
examp le 6f the^dialogues it has supuport^ed. This section 'presents an 
annotated dialogue of -a student using the "Intelligent" CAI ^ system 
SOPHIE /( 1 ) SOPHIE wa s dev elope d 'to explore the use of artificial 
intelligence techniques in providing tutorial feedback to students^engaged 
in p-rerViera solving activ'ities. \Th§ particular probl^m^ solyj^ng activity 
that SOPHIE is concerned with is the tro.ubleslrootfug^of a nial f unc t ion £ ng 
piece oC^ elec'tronic equipment". SO PHI'E. models the piece ^f equipment and 
answers' ^ the student' s. requests for nieasu reraen t s'^ndT ,^he r information to 
aid him ^n debugging the equipment . ' More imp^t^nt , thr^fbghout the problem 
solving session, SPPHIE can^eValuate the^ logical. consistency ojT a student's 
hypothesis or generate hypotheses^ which. a re consist en t with the' -behavior 
^the studenthas thus-^Tar*- o'bse'rved A 2) In the d ialague , the s tuden t ' s 
typing is ' urrderlined. Even though the dialogue deals. with electronic 
jar go n, the linguistic i ssues *it exemplifies occur in ^*£ill ^^ho mains. 'The 
annotations * (lower case, indented) attempt to point out th.ese problems and 
-sh^ou,ld be understandable to the* noni-el ec tron i cs oriented reader. 
'WELCOME TO SOPHIE - A SIMULATED ^ECTRONlCS- LABORATORX ^- 



(The circuit (Figure 2.1) is based. .Dp J^he-Heathkit I'P-2 8 bower supply.. 
The lP-28 is a reasonably sophisticated power supply with bot^h cyt^ent 
limitrng and toI tage limiting behavior- These two interrelated 
feedback loops m^ake troubleshooting this circuit non*trivial, 

>>IKSEftT A 




The studeh< tells , SOPHIE to make one of the compionents in the circuit 
^ bad so thaVjie can troubleshoot- i± . SOPHIE randomly selects a fault, 
inserts it Into a model of the'^^,inffJWe:i|pen t and fells' the' student how 
the front j)anel controls 'are presently set. - 

TilE IKSTfiuMEKT HAS A 'FAULT AKD ITS PFfESEKT CONTROL SETTINGS ARE: 

CC vKO . CURRENT CONTROb*,FROM 0.0 (MIN CURRENT) TO 1.0 ^ " 

CR .HIGH' '--^CURRENT RANGE SWITCH^HIGHr 1 AHP/ LOW = -. 1 AMP 

LOAD' 1000 ^ ' LOAD RESISTANCE IN OflWS 

VC 1>.0 VOLTAGE CONTROL-PROM 0.0 (MIN VOLTAGE) TO 1.0 

VR . HIGH VOLTAGE RANGE SWITCH, HIGH=3.0, LOWrlO VOLTS 

* ' , - - • 

^ ' __ - 

TTJ Thi dialogue is int«rrid^ , to ■ demonstrate SOPHIE ' s ITnguistic 
capabilfties ana* while it touche's upon the major features of SJCIPHIE, It^is 
not 'me ant 'to exhibit the logical or deductive c*pabil it^es the *^syste!D . . v - 
(2) The rea'Ser i»s encour^agea to see-'tBrown and Burton 1975) -for further 
exaiDpl-e&^-*^ and descriptions fcrf SOPHIE'S^ *tutorial . and Inferential 
capabM'i^ies . 



> > WHflT IS THE OUTPti 
OUTFT => OUTPUT ^ 
THE OUTPUT' VOtTAGE IS 1.2 VOLTS. 



, SOPHIE corrects the student's typing mis^take. 
Notice that "the output" was disambiguated as, the output voltage. , 

Hl^8"c5SrECT?"^"^^ WHET^B a VALUE^IS correct, you can A^jK^IS THAT 
>> IS THAT. RIGHT . 

IN A WORKIHG CIRCUIT THE OUTPUT VOLTAGE IS 30*1 VOLTS. 
THAT VALUE IS INCORRECT.. 

SOPHIE permits reference to previous objects in the dialogue. Here, 
"That" refers to the value of the prev ious measurement. » 

>> WHAT IS THE VOLTJUIS BETVEEN THE CURRENT LIMITING. TfiANSISTOH 
... AMD THE CONSTANT Curremt- SOURCE? ^ *i,An,^*w.v , ^ 

THE VOLTAGE AT N 4- IS. 2 . i»B VOLTS . • - ^ - 

This is an example of some of the^complexitieS that arise in ^ven 
limited^domains^ Al though the syntax of the sentence is ''voltage 
betweei\ x and y"»^ it really meanS "voltage' at z with respect to 
ground'* where z ^.s the point b^*^een x and y,* The output routines 
re phrase thev input in a simpler form (i*e., between x and y reduces to 
HUj so that the user know^ the system's ^interpre tat ion and has an 
easier way of re f err ing to that ^loca t ion ; 

>> WHAT_IS IT BETWEfeM THERg ASP THE B^SE_0F_Q6 ' ^ ''^ ^ 

THE VoLtAGS. betweek nu akd TJs iS iJ5 vOLTsT 

Here "if* refers to "the voltage" and "there" refers >td KU. 
Also no^tice th^t^,"betweeia" has to be *treated. diff er,ently\ 
i,e + ' two nodes* are explicit* now* 

>> IS THERE AKY RIPPLS. IK THE VOLTAGE ftT^THE BASE OF QM? ^ 

I'M SORRY, ^1 DO KO^ HAKDLE AC CHARACTERISTICS, . ^ 

SOPHIE t*:;6cogni zes that the student is' moving into an area that 'it is 
unable to l^andle* This is currently done by keyword recognition (e^-. 
, ripple) but' points ^ out a technique that should be incorporated in 
otheraspectsof thesystemaswell^ 

THr^MsPrflM^^ 

The following col lection of seijte^ices demonstrates the conciseness and 
. frexibility^ of the dialogue mechanism* After introducing a context in 
a complete sentence, tbe student can easily and naturally ask related 
questions . 

>> THRU.THE EMITTER? ^ ^ ^ ^ 

THE EMITTER CURRENT OF Q| IS ^,26 MILLIAMPS, ■ ^ 

This type *of ^sentence fragment, which we will refer to as an ellipsis, 
occurs* frequently in . dialogues . Rather than specify ing a complete 
thought; an ellipsis only gives that piece of "the thou'ght which 
contrasts aii aarl ier thought, Kotice that the re fe rent cannot be 
determined on syntactic grounds (as is 'possible with the ellipsis "the 
emitter^Gurrent"); yet this is the sort of statement a student might 
make if the last answer had caused a slight shifting of his thinking. 



> >Qii 
THE^ 



EMITTER >CURREKT OF IS -,26 MILLIAMPS, 



In this case^ the atudent is changing his a'ttenti^on *to^ a difrerent 
itransistDP* There is ambiguity as to whai*e he 'wanted tlbe base 
cvrrent, the emitter ^current or both. SOPHIE 4^1^ks the mo-st recent 
one and giv^^ its interpretation as a complete ^sentence, 

> > IF C2 WERE LEAKY, WHAT un ULD TH^VOLTAGE ACROSSl IT EE? ' V 

As this sentence srhows^ the re fe rent to' "it" can^ccur ea r lie r'^^ln th e 
same sentence , . * • 

IS IT OKAY IF I USE 10000 FOR THE LEAKAGE RESISTANCE OF C2? 

> lES ^ ^ ^ V . ' 
IFHTtE LEAKAGE RESISTANCE OF C2 WEfiE' 10000 \ 

UNDER THE PRESENT SETT ING$ , *THE VOLTAGE A.CROSS C2 WOULD BE £6,3 VOLTS. 
IN A 'WORKING ^CIRCUIT IT IS '28-9 VOLTS. - - ^ ' 

>> iy Q6 HAS AW OFEN EMITTER AND A SHORTED BAE COLLSCTO R JUNCTION 
.Tt WAT HAPPEHS TQ THE VQLfAGE BETWEEN ITS BASE AND THE_JU^[QT]:OK OF 
. • > TH£ VQLTGS .LIMITING SECTION AND THE_VQLTAGE REFER ENQ£^SOU RCE?" 

BA£ => BASE r . ' ^ 

VOLTGE = VOLTAGE 

Severa>-Hexamples of the use of conjunction,' Imagine the student* s 
frustration if he is forced to type this query .over because of 
,spellin^ mistakes., 

UNDER, TME SETTINGS: ^ \^ ^ ^ ' ' ^ 

.CC=,9. CRrLOW,- LOAD=10, VC=KOj VR = 10W. 
THE VOLTAGE . BETWEEN N5 AND N13 WOULD BE 8,9^ VOLTS, 
IN A WORKING CIRCUIT- IT IS 9*-57 VOLTS. 



> > ^HAT IS THE CURRENT THRU THE CC -WHltL THE VC^j _ SET TO 0 ? 

WITH THE TOLTAGE CONTROL NOW SET AT KO 

THE CURRENT. THRU THE CURRENT CONTROL IS 30 MILLIAMPS, 



r 



CC and VC are Abbreviations* The controls are also "parts'* that can 
be u aed i n meas^u rement s , 

>> WHA1 IS IT W T TH ^ s4t to ^8? 

WITH THE VOLTAGE CONTHOL NOW SET AT .8 

THE- CURRENT THRV THE CURRENT CONTROL IS -24 MILLIAMPS, ' , 

H^r^ the system must correctly instantiate two occurrences of **it'*. 
The referent to the second *'it*' could be either CC or VC since these 
are both controls* ^ 



S e c t i oiv-^ '■" 



INTRODUCTIQB 

, » * * t ^ 

* I «^ - ^ - 

In Section 1 we described' l the requirements for a natural language 
processor in a learning env^ironment • Briefly, they* are efficiency and 
friendliness over the olass of\ sentences that aris^ in a?' dialogue 
situ aft ion. The major leverage points we have^ that allow us to satisfy 
these requirements are ( 1 ) limited domain , ( 2 ) 1 imi ted activities within 
that domain , and ( 3 ) knowti conceptualizations of tir'e domain . ' In other 
words, we know the problem area, the type of p^robl em the student is tryrfrg 
to solve, andthe way he/sh^ should be thinking about "^he problem in order 



to solve it. What we are then f^ced^.with* is taking advantage of these 
constraints^in order to provide effective communic^]:lon ch^nel,' . 

Notice that all of these " constraints relate to'conceg^ts u^nderlying the 
student ' s fac tiv i ties . In SOPHIE , the concepts include '^o^l tage , current , 



^parts , 



terminals, f aul ts , 



transistors , 
controls, se-t lyings of controls, and so on 



,partlou^lar ^parts, hypotheses^- 
The ' depei^encj[_ relattionships 
between concepts include things such as^A, voltage cfin be measured at 
terminals, parts ca.n be faulted, ^cont'rols can be set, etc. The student, in 
formuM^iJig a query or sta'tement, is requesting information or stat^ih^^^a 
beiy^f about one of t,hes^ relationships (e.g. "What is the voltage at the 
colA-ector of transistor Q5" or "I think resistor R9 is open".) 

, It occurred to lA^ that the best way to^- Characterize the statements . 
Vsed for th^s t^sk was In terms of the concepts themselves as orpposed ta 
the traditional syntactic ^tru ct^ures . Tt^e language can be descjj,be d by a 
. 3et of grammar rules tha t ^charac t er i ze , for each concepf'or relat-ionship , * 
all of the ways of expressing It in terms of other ^ constituent concepts. 
For example, the , concept of a measurement requires a quantity to be 
measured a^nd something against which to measure it. ~A measurement I's 
typicy^ally expressed by giving the quantity 
f oriowe<i'^ by the thing that specifies where to 

across capacitor C2", "current thru divide Dl". These phrasing^ are 
Captured in the grammar rule: (This* is nQt actually * a rule from tbe 
grammar - but is merely intended/to be %^gges t i v e . ) ^ i ^ 

* ' <MEAiSUREMENT> ;= <MEASlJR4BLE/QlJANTITY> <PaEP> <PART> 



followed by a proposition, 
measure (e.g, "voltage 
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The 4^ 'C onc>pt o 
con cep ts I e.g. to 
capaci tor ' C2? ; or 



turn , be usei^ as part of other 
"What is the voltage across 
to' check a measurement. "Is^ the current thru diyide D1 



measurement "ban, in 
Bluest ' a measurement 



c orrec t ? " 



"1 



call this type of grammar a "semantic grammar" because th^e 



relatio^nships it tries , tq characterise are semantic/conceptual as well as 
syntactic. 

Semantic grammars ha^e two advantages over traditional syntactic 



gra mmar^ 



They allow semantic constraints,^ to be used to make predictions 



during the'Parsing process, and they provide a useful characterization of 
ttiose sentences that ^ the system should try to ^handle. " The predictive 
aspect Is important for ^ four reasons; (1) it reduces the nutober o|f 



alternatives that , must be checked 



at 



a given time; (2) it reduces the 
amount of syntac'tic ^grammati^calT ?mb^igu).ty ; {S) 'it allows recognition of 
ellipsed or deleted phrajses; and ^4) jiermits the parser to skip*words at 
controlled places in the input (i,e. it ena"bles a reasonable specification 
of control) , These points will be discussed in detail in a later section* 
T*he. characterizalTion aspect is' important for twt> reasons ; ( ;i 3 ♦ 1 1 
provines a ,handle on the problem of constructing a habitable su b- language^*^ 



I. 



The, System knows haw to deal' with a* particular set of tasks over ^ 
particular set of objects* The sub- language can be partitioned, by tasks to 
accept all straight forward ways ofexpressing those* tasks^ but does not 
Vie^d to worry about others; (2) It allows a^^reduction in the number of ^ 
^^^.^--^n t en ces tha t muy^><Ja/J accepted by the language while still maintaining 
habi ta bi li"ty% There may be syntactic constructs that are used f r equen t ly 
with one concept (task) but seldom i/ith ano th er + for example-, relative 
clauses may be ^ useful in explaining the reasons for perfprmiag an 
exp^ri menj:al t e?s t \>ut ' are an awkward (though possible) way of requesting a 
measurement. By separating the- processing a long -^s emantic grounjls, one' may 
gain efficiency by hot havirtg to accept the awkward phrasing * 

REPRESEHTATIQH Of'meAKING . - * , 

^ Since, natural language commtinicatlon is the transmission of concepts 
via phrases^ the* **mea'ning** of a phrase Is its correspondent ^iSeS^'the 
concept^l^al space* The entities in SOPHIE's conceptual space are obJ*e5^s , 
relationships between objeqts, and procedures for dealing with ob^Jects, 



The meaning of a phrase can be a simple data object (e.g* /*curyrent Idmltinlg 
trans J, St or**) or a complex data object (e.g. *'C5 open**, **3[^ tage at node ' 
I**)*, ^Xh*e meaning of a question is a call to a procedure that knot's h"bw t^ 
determine the answer, The meaning of a command is a, call to a procedure 
thaV per former the specified action. (Declarative sta^em^nts are tr elated as 
requests because 'the ^pragmatics of tfhe situation imply that the student is 
asking for veri^^ica t ion of his s tat ement . For example , **I th ink C2 is 
shorted'* is^ taken to |)e a' request to have the hypothesis *'C2 is shorte^" 
critiqued.) For example , the procedural specialist DOFAULT knows how t(3 

of commands to fault 
and R9 * opjens*' ) * Th e 

argumen^t that OOPiuLT n-eeds in order to perform its, task is an instance oT 
the eoncep t of £au Its'^ *t hat, specifies t^ie particular changes to be made , 
e.g. **R9 being open**. These same concepts of particular faults also s-erve 

^s arg^um^ftlnts to ■ two other specialists;. HYPTEST which (Jet-ermines the 
consls^tency of a fault with respect to the present context, e.g. "Could R9 

'be open**j \^nd S^EFAULT which^ checks the actua^l status of the circurt, e.'g- 
*»Is R9 op^?"* ^ 

RESULT. OF THE PARSING 

Basing -the grammar on concepttfal entities allows the semantic 
interpretation (the determination of the concept underlying a ^ phrase) to 
proceed in'* paral lei w 1th the ^ parsing. Sinpe each of the non- 1 erm inal 
-categories in the grammar is based on a semantic unit, each grammar rule 
can specify th'e se.mantic description phrase 'that it recognizes in ^much 

the same^ way that a syntactic grammar 3pecifies, a syntactic description* 
The cons t ruction port ion- of the rules is procedural * Each rule has the 
freedom to decide how^ the seman t ic ^ descriptions, returned by the 
ccwfsWtuent items *of that riile^ a^e. to be V-^t to^et^her to form th^e correct 
**-iDeaning'* . . ' . 

For example, the 'meaning of the phrase **Q5" is the data base object 

QS/ The meaning of the ' phr^^j^he collector of Q5**, ^ is (COLLECTOR ^5) 

where jfe^CpLLECTOR is a function, that returns the data base item^ that is the 

collector of the given transis^tor . ( 3) ^ ^ - -j 

' * J- ' 

(3) The language LISP will be used" in examples* In LISP, a function call 



/ 
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V 



The rule for <ME ASUREMENT> exp res ses • a 11 of the ways that the student 
can, give a measurable quantity and also' 3U^)ply its 'reqwi red^ a rguraen t s . The 
stri^cture which results rv(M <ME ASUREMENT> is a function call to the 
function ME ASU RE which supplies the^ quantity being meaaured and other 
arguments specifying where to measure it. Thus the me^ani'ng of the p^hrase 
"the voltage at the collector of'Q5^ is (MEASURE VOLTAGE (COLLECTOR Q5)) 
wh ich was gen era ted from t^he control structure; 



maasurem^t^^i^ 

/ * ' ^^^^^^ 

me as,/ q uan t n-od e 



'-v,ol t age 



termina 1 
terminal/ type 



part 



coll ec tor 



Q5 



The^ grammar rule foV <MEASUREMENT> also accepts "meaningless" phrases 
^ucb as "the power dissipation of Node In addi t ioi>, it accepts some 

meaningfiTir phrases su<Sh as "the tres^tance between Node 3 and Node 14" 
whicji SOPfflE does not calculate ; This re*3ul ts from generalizing together 
concepts which ^ are not treated identically in the surface structure* In 
this case J voltage, current, resistance and power dissipation were 
generalized to ' the concept of a measurable quantity. 'The . advan tage of 
allowing ^ the grammar to accept more statements * and having , the 
Argument-checking done by the procedural specialists is that the semantic 
routines provide the feedback as to why a sentence cannQt be interpreted or 



Ts expre'ssed in Cambridge-Polish nx^ta tion : as ^ parenthesized list of the 
function name followed by its arg^uments - ^ ' ' - ^ 
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"undje rstood*'* It also keeps the grammar from being c lu tt(,si:L0fl with special 

rules for ' blocking meaningless phrases. Carried to the limit, the 

generalizatibn strategy woy^ld return the grammar to being syn tacUic 7 again 

{e*g- all data ob/ects are "noun phrases")/ The trick is \o\ leave 

se mant ic & in the g rammar when it is beneficial to stop extraneous 

parsings early, or tighten ^the range^of a referent for an ellipsis ^ or^ 

deletion. Tftis is obviously a task- specific trade-off* ( Bob row and Bro^tSn 

( 1 975 ) d escribe an interesting pai^adigm Yrbm which to consider this 

i'trade-of f * ) ^' ^ . . ' , . 

The relationship between a ^ phrase and its meaning is usually 

straightforward. However , it is not limited to simple, embedding. 'Consider 

the phrases "the base emitter of Q5 shorted" and "thef^ase of Q5 shorted to 

the eraitter^T ^The thing which is ''shorted" in both of t hese\h rasjes is the 

"base eiiitter junction of 0*5*" The rule that recognizes both pf these 

* 

phrases, <;PABT/FAULT/SPEC> , can handle the first phrase, by invoking its 

constituent concepts of <JUNCTION> (base emitter of Q5) and <FAULT/TyPE> 

(shorted) "and combine their, results. In the second phrase^ how ever, it 

must construct the' proper junction ff'om^ the Separate occurrences ^f th^ two 

te rminal sinvolved* * i 

This discussion has'been presented as ^^f^the 'concepts were defined 4 

priori by the capabilities of the system. Actually, 'for the system to 

remain at all habitable, the concepts are discovered in— the — intferplay 

between expanding the corpus of sentences tbe system can handle and addling 

capabilities to the system. When a particular English con struct is 

difficult to handle, it, is probably an indication that the concept it^ is 

trying to express has not been j^ecognited properly by the system* In our 

example "the base of Q5^ is shorted to the emitter"-, the relationship 

between 'the phrase and its meaning is awkward because the present concept 

of shorSing re'<luires a part or a junction* The example is ^S^t^^^ at a 

concept of shorting, in which any,two terminals can _be -shorted together 

(e,g. "the positive terminal of R9 is shorted to the anode of This 

* 

is a viable 'cone ep t ual view of ** short ing" , ^i ts imp 1 ^to^ tat ion r equ ires 
allowing arbitrary changes in* the topoLogy of Jthe 'circuit which is beyond 
the efficiency limitations of SOPHIE* s simulator* Thus, the system we were 
wor king with. led us to define the contjept intoolimitedaway* ^ ✓ 



U3E OF SEHAmTIC IMFQR MATIOH DURING MRSING \* . 
Prediction - ' ^ • • . ' 

Having described the noti on of 3|. setbantic ^r3iDiD3rf -we will now 
describe the ways it - allows semant4c ! in f 6rjiia ffion tjo.^be used, in the 
understanding pro cess. One use of getftant i c gr^maJts is to predict the 
possible Alternatives that must be.-cli^cked ^atxa given point. Consider, for 
example, the phrase "the valtage at xxx,"/ "After thVwcJrd "at" is^ reached 
in the top-down, 1 e ft- to- right parse, the grammar'ruL/ corresponding to the 



concept "measurement" can predict very specifically xhe conceptual- nature 
of " xxx" : it must be 
location in the circuit ^ 



a phrase that directly or indirectlv specifies a 
For example ^ "xxK** 



could be J* the junctions of the, 
current limiting. Section and the froltage reference saurbe" but cannot be "3 
ohms" * . 

Sejuantic grammars also have .:^he effect of reducing the arao^un^. "of 
ammatical ambiguity. In the phrase ^the voltage a£ xxx", the 
prepositional phrase "at. xxx" will be associated- witiCt the noun "voltage" 
wi'tlvS^ considering any ^alternative parses th^t associates it sotae place 
hi^sijer in the tree. - *^ ^ 

Predictive ,inf o rma^On ' i s also^^^iteed to aid *in the determination of 
referents for' pronouns. If the above phratfte were "the voltage A. it", the 
grammar - would be able to restrict the cl-ass' of possible referents to 
lod^^ioh^. By taking , ad^f^ntage' of the available sentence contexts to 
predict the semantic class of possit>le re f,e rents, the ' referer\t 
de-termination process is greatly simplified. For example;. ' . - ^ 



1a 
lb 

1c 



Set the voltage control to .8? 
What is the current thru R9? 
What is it with it set to .9? 



In (1c), the grammar is able to recognize tha^ the, first ""it" refers to a 
measureme'nt that the student would like re* taken under slightly different 
conditions^' ^ The grammar c^n also decide that. the second **it" refers to 
either a potentiometer or to^the lo^ad resist ance (i.e. one of those things 
which c^an be set). The referent for the first "it" is the measuremejit 
taken in— iO-b^v "th'e current thru the referent for the second "it" ^ is 

"the voltage control'** which ^is an 'instance of a potentiometer. The context 
mechanism that selects the l^eferents will be discussed later. 
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Simple Deletion , ^ * / ^ 

'The semantic grammar^is also used to reoajgni ze" ^mpl^^ dej.^t ions * . Th e 
gramn^a r rul,e or >aoh.. conceptual ^ntity knows tlie nayure ^o r ^th*t entity' s 
constituent concepts, WheiJ a rule cannot find a/constiliuent^concept,, it 
can either: - . 

' ' . : ; 

a) fail (if the missing concept is 'considered t\ he ,jobrf*gatQ'ry in the 
surface structure representation) oPj^ 

b) hypothesize that a deletion has occurre^d aJfid continue, 

For example*, the con'cept of a TERMINAL has as tfne of it^ reaf^ations the 
constituent concepts of a TERMJNAL-TTPE and .a PART, ^he'n its g»^mmar ^ rule 
finds only ,the phras^^ "the collector", it uses this informatljon -to posit 
that a part has been deleted (i.e. TERMIHA^-TJtlE gets in'stantiated "the 



collector" but^ nothing gets trrstantiated. to PART) 



The natural language' 



p roc es3o r tllen^ u s^s t he xJepe nderic ies between,- the cons^tit^Jeni concepts to 



determine that the deleted PART must be a TRANSISTOR. '^he./'>* 



e^ninle' 



of 



this phrase is then'^the collector of sope transistor". . t Whi^oh transistor 
is determined when the meaning is evaluated. Un the present dialogue 
context. Id particulafP, the semantic f orifl' > etu r ned is the functisbli PREF 
and tfie classes of-^^cTssili^ referepts; in pur example "the'/form* woflild 

The? operation of, PfiEF will be Biscuss^d 



(COLLECTOR 
latet*. 



(PREF '(TRANSISTOR))) 



Another use of* the semantic grammar*. allQws the processor -to recognizees 
elliptic^ utterances- -^hese are ^utterances that do not express complete 
thoughts^ a completely siJeqified question or comman^J bu't only g^ive 

, differences between tl;^^e intended tjiought and an earlt4-«c v one . ^1) For 



--example, 2b, 2c and 2d are< ell i ptic *utter ances . 

!''<■' ' ■ ' ■ i, • 

2a) What Ifs^the vol tage** at?^ Node 5? ^ 
2b) At Noflefl? 
:2e) and Hod^ 2? 

2d) .What .aoout between nodes 7 and 8? 



i: s 



(^) the .standard use of the word "ellipsis" refers to anV deletion Ra th^r 
,than invent a new word, we shall use t^ne restricted meaning here. 



Ellipses can begin w itlP^l^t roduc tory phrases such as ^'"and" i/i 2c or "wha't 
?bout" in 2d; however this is not required as cani^be seen in 2b. Part oS 
the ellipsis rule- is gi,ven -in Figure 3.K * ^ 

, ^ , ■ ■ Figure -S.-l ^ - 

Ellipsis ftule 

<ELLlPSIS> ;= [<ELLIPSIS/IHTRODUCER>] <REQUEST /P IECE> ! 

f . [<ELLIPSIS/IKTRODUCER> J if <PART/FAULT/SPEC> 

<XeQUEST/PIECE> :^ [ <Pi?EP>1 <NODE> I ? 

[<PREP>] <PART> ! ' ' . ' - ^ 

between,-<KODE> and <KODE> ! 

[ <PREP>] <JUNCTIOK> ! - . / _ 

/ etc. ^ ■ L » ^ 

The grarimar rule identifies which concept or class of concepts are possible 

from the context available in the elliptic utt erance/^x,* ■ ^ 

> Wtiile the parser is usually a\le to determine theSi?rt ended concepts 

from the context available in an ellJLptic utterance, this is"'no^ always the 

case. Consider the following two sequences, of "statements. 



(3a)What is the voltage at Node 5? ' . 

(3bi 10? ^ ' - ■ ' - / ^ 

(4a) What Is the^^ output voltage" if the load is fffo?- \ 4r>\ 

Jn (3b), "10" refers to node 10> while, in (*fb) 'It refers to a load .of^ 10, 
The problem this^ presents to the parser is that'the ' concepts 'underlying 
these two elliptic utterances have no thing in common except their surface 
r e'al iza t ions . Th e pa rser , which operates from cbncep tual antiti^es^ does not 
have^ a concept that includes^both of these interpretations* One solution 
yould be to have the parsejc find all parses (concepts) ^and then choose" 
bet we en them on the basis of con t ex t . Unfortunately> this would niea'^n that 
time is wasted looking for *i^ore than one parse for the .large percentage of 
sentences in which it is not necessary to do so.'^ A better solution would 
be to allow structure' among' the concepts > that the parser would 

recognize "10** as a niember. of the -conc'ept "nOtnber'*. Then the rou twines that 
find ' the referent, would ■ ftnow th^t n^umbers pan be either node numbers olr 
values* ' This type of recognition could profitably be per formed by a 
bottom -up "approach to parsing. However^ ^ts advantages overthe p r'e^en t 
scheme are 'not enough t'o justify J^he expense incurred by *a bottom- up parse 
to find all possible well- formed constituents. At present * the parser 



33ume3 one Interpretation, and a message is printed to the student 

indicating .the assumed interpretation, if it Is wrohg, the^ student must 

r 

supply more context in hi^ request* In fact, "10?/^ is taken as -a load 



and i f 



specification 

10", "Hia^ or "Node 10". Later' we will discuss the 
determines to which complete thought an ellipsis refers, 



the student meant the node he would 4iave V> use ^*3['t 
* * ^ ■ * 

mechanism that 



USING 'CONTEXT .TO DETERMINE' REFEReVts/ 
^ Pronotin? an.d Deletians 
5nce' the 



par ser ha^ det er m i^^ 



the existence and class (or set .of 



classes) of a p r ono un or deleted object, the context niechanism is / invoke d 
to determine the proper referent. This mecha^nism has a history of student 
interact ions during the current session which contains, for , «ach 
Interaction,' the parse .(meani'ng) of the student's 3tatement ' ^d the 
response c^lcul^ted by the system. This list prqvides the range of 
possible referents and is searched' in reverse order to find an object of 
the pVoper^ semantic c\a,ss (or one of the proper classes)* To aid in the 
search, "Ihe context mechanis-m', knows how each of the procedural /specialists 
appearing irva parse uses' its arguments. For example, th e _^ special i,st ^ 
MiEASURE has a first argument that ^^^^ be a xjuantity and a second argument^ 
that must be a part, a ju^nctipn, a section, a terminal *or a .nod$, , Thus 
when the con'text mechanism Is looking for a referertt that can either be a 
PART or y^.UNCTION, it wl^l look at the second .argument of a call to' 
MEASURE^ but not the first. ^ Us ing the information about the specialist-s , 
the context mechanism loQks In the present parse and then in the next most 
recent parse, Vtc , until an ob^^ect from one^ of the specified classes is 
found * ' ' > ^ 

The significance of -using the specialist to filter the /search instead 
of jui't keeping a list of previously^mentioned objects is that it avoids 
mis-interpretations due to .object- <:oncept ambiguity. As an example, 
>j consider the follow ing sej^u^nce f r<jm the sample dia^logue in Section 3: ' 



(^^). What is' the current thry^the CC when the VC Is 1*0? 



What is It whep it is .t!? 
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Sentence 
grammar : 



(5) will be j^ecognized , by the following rules from the semantic 



i1 



<fiEQUEST> :=• <SIHPLE/REQUEST> when. <SETriNG/CHANGE> 
<SIHPLE/SEQ0EST> := wl\;it is <HE ASOREMENT> 
<HFASUREHENT> := <MEAS/QUANT> <PfiEP> <PAfiT> 
<SE3:JING/CHANGE> := <CONTfiOL> is <CON'yiOL/VALUE> 



$5) <C^NTfiOL> := VC 
with a resulting semantic form of: ' * 

( R^SETCONTROL *( STQ' VC 1,0) ' - ' ' • , 

(MEASORE ,.CORRENT Cc)) , 

. BESETCOtiTROL iys ^a function whose first argumervt specifies a change to 
one, of the controls and whose second argument consists of a form to b*e - 
evaluated in the resulting instrument context. STQ ,is used to c^han'ge- the. 
setting one of the controls. The first argument to MEASURE gives the 
quantity to be measured. The second specifies where it is to be measured. 
To" recognize sentencje (6), the* application of rules $2 and $5 are changed* 
There is an^ alternative rule for <SIHPLE/REQUEST> that looks for . those . 
^anaphora that refer to a measurement, fhese ptli^arses , suchas "it*', "that 
result*' ' / or "the value*^, are recognised try the .noa--t^4im-^Lnal 
<HEASUREMtINT/PfiOHOUN> - The alternative to $2 that would be used to parse 
(6) is: ^ 

"'<SIMPLE/ftEQUEST> what 'is <HEASUfiEMEHT/PfiONOUN> 
The semantics of <ME;ASUREH£HT/PF?bNOUN> indicate that an entire measurement 
hasbeendeleted. Thealternativetorule$5: 

'<c6hTR0L> it ' ' * ^ 

recogtjizes "it" as an acceptable way to^ specify a control,- The resulting, 
*seii^ntic form for sentence^(6) is; ^ 

- (HESETCONTROL (STQ (PREF ^'(CONTROL)) ,8) 
(PREF MHEASUREHEHT) )i 

The function PREF searches back through the don text of previous semantic 
forms to find the m^st recent mention of a memtner one of the classes* In 
the above example, it wilL find the control VC but not CC because the 
character imposed on the arguments of MEASURE is that of a "part" not a 
"control*^. The presently reoognized ^ classes for deletions are PART, 
TRANSISTOR, 'FAULT, CONTROl:, ^POT , SWITCH, DIODE, MEASUREMENT- and QUANTITY. 



(The members^ of the classes 
associated 'with a circuit*) 



are derived 
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from the semantic jietwork 



J 



V 



Referents fon Ellipse^ ^ 

If the. problem of pronoun resolution 'is looked upon as finding a 
previously men t itfned object for a currently spe^Urf t ed use^ then the problem 
|j of -ellipsis oan*be thought of finding, a previously mentioned use foK ^a^i 



currently specified object, * For example 

{7> What^ ds the base current of Q^? 
(8) ^In Q5? ' , 



\ OS 



Xhe given ob j ec t ig "Q5 V , and th'ei 'earlier function is *^base current*^* 
a given elliptic phr arse,,, the* semantic grammar identified the c'SVicept 
class of concepts) involved. In since Q5( is recognized by the 

non^-terminal .<TRANSISTOft/SPEC>, the olas% would be TRANSISTOR, The^co.ntext 

" mechanism theh seal^ches for a 'specialist in a previous parse that accepted 
the given *S^lass as an * argunrent . Whe*n one is found, the-^hew phrase is 

. placed in the' proper argument position and the mod ified parse is used *as 
the m^^arring of the el^lipsis^, 

^ LlmitaU.cvn3 to the Context-. Me^^haniam 

The method of semantic classification (to determine reference) is'ver^ 

efficient and works well over our domain. If definitely doeg^not solve all 

the problems of reference* Charniak (1972) has pointed out the substantial 

( probleius \of reference in a' donjain as seemingly simple as children's 

stordes* One of his examples dempnstrates howsmuch W€)rld knowled ge ig ay be 

required , to determine a referent (197,2 p, 7'). 

Janet and Penny went to the store to ^et presents for 5,ack, Janet 
said ''I will get Jack a top*' *'DonU get Jack a toj>^ ^aid Penny. "He 
has^ top'. He will make you itake^ it back^" - ' 



Charniak argues that to understand which of the two tops '^it** 

refers, requires Ij^nowing a bo ut* presents, stores and what they wills take 
back, etc* Eveh, in domains where it may be possible to capture all o*f the 
nece'ssary knowledge, classification may stijl lead to* ambiguities- , For 
exaropl'e, consider the following: 



(9) 



What is the voltage at Notfe 5 t-f the load is 100? 
7? 

A 



jjOj Node 6? 
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In statement (11)* the' user mean s Nod'e ^ 7 • In s ta t emen ^ (10), he has 
reinforced the use of ellipsis as referring to node number* ( For example , 
leaving out s1>at em^en t (.1 0,) , s tat^ejnent ( 1 1 ). i s «uch.. mo&e awkward * ) On the 
'Other hand, if statement (11) had been ''lOOO'' or if s ta temen t^* ( 1 0 ) had been 
,''10?'*, things woyld be more problematic * When statement (11) i 3 ' 'M 000" , we 
can infer that he. means a load erf 1000 because Chere is no node 1000. If 
statement -(10) had been "10?", th ere would b^e ,genuine ambiguity slightly 
favoring the interpretation a*s a load because*; that was ^he last number 
ment Tone d + The majp^^ limitation of the current- technique, whicji mu^t be 
overcome in order to t^ckleslrgnificanfcly more com plicated domains* is* it^ 
Inability to return more than one* possible refartfnt* It considers each one 
individju^lly until it finds one which is *sat is f ac t o-r y . 'The amount of work 
involved in employing a technique which allows comparing deferents has »ot 
been iu stifled by our ex'per iehc e . 

FUZZINESS \ • , ^' 

Having the grammar centered around semantic categories allows the 
^par^er to be sloppy a bo lit theactual woi*Th& it find-s in the statement* 
Having a concept in mind, and being willing to ignore words to find it, is 
the essence of keyword parsing schemes- It is effective in those cases 
where the words that have Veen skipped are eit^t^r redundant, or spe^cif^y 
gradations of an idea th&t are ^ noJ> disti^uished by the system. For 
example', in the sentence; "Insert a 'very hard fault", "very" would be 
ignore'd ; this is effective because the system does n^t\ have any further 
structure over the class of hard fafllts* In the sentence: "What is the 

K * 

voltage across resistor R8?*' i^esistor can be Ignored because It is implied 
by "R8"* (Tlie first of these examples could be handled by making "very" a 
noi^e word (i*e. deleting^ it from all ^ sen t enc e^ ) * Resistor however is not 
a noise word in all cases (e*g* *!What is the'current ^ thro*ugh the current 
sensing resistor?") and hence cannot b^ deleted* 

One' advantage that a pt^ooedural encoding of the "grammar (discussed 
later) has over pattern 'matching schemes in the implementation of fuzzi^ness 
is its ability tb control exactly whebe words' can be ignored, Tfri^ 
provides 'the ability ^ to blend pa t tQrn*ma t chihg parsing of those concepts 
that are arntenable to 'it with the * structural parsing ^reqlTired by more 



21 



\ 



complex concepts. The ampunt of fuzzine^s how mariy. if any, words in a 
ro*{ can be ignored is controlled in two ways* Fir s t , whenever a grammar 
rule is invoked^ th% calling rule has the option of limiting the number t)f 
word s tha t can be ;3 kipped * Secon'd ^ each- rule can decide .which of its' 
con s t i t-uent pi^c es— words are required and how t ightly cxmt rolled the 
search for them Should be* In SJOPHIE^ the normal mode of operation of the ' 
parser' is tight in the beg inning of a sentence, but f jazzier after it. has 
madesenseoutofjSomething; • ^ 

Fuzziness has two^ other advantages worth mentioning briefly* It 
reduces the size Qf the d io t i onary because all known noise words don*t have 
to "^be included. In thos^cases where the skipped words are meajij-tigf ul , the 
misundeiistanding ^ay provide some clues to the user which allow him to 
restate liis query. 



PREPROCESSING ' ♦ 

" Befpre a statement is par sed , a^ preprocessor performs three 
operations . The first expands abbreviations , deletes known noise words , 
4nd capon ic^lizes similar words to a common form. , The secotid-tis a cursory 
spelling correction* The third is a reduction of Compound words * 

Spelling correction is attempted on any word of the^iniSut*"string that 
thie sys^tem^oes not recognize. The spelling correct ^.on algorithm(5 ) takes 
the possibly misspelled word» and a li*st of corijectly spelled words, and 
determines which, if any, of the correc t .word s is elose to the ^"^i sspel led ^ 
word (using a metri,c determined by number 'of transpositionja , doubled 
letters » dropcfed letters, et^c.X^ During-the initial preprocessing, the 
list of correct words is very small (appn^oximately a dozen) and is limited 
to*' very commonly misspelled words and /or words that are ^critical to the 
imd*r standing of a sentenpe . ^ Th^e list is kept-smaLl so that the time spent 
/attempting spelling correction, prior to attempting a parse , is kept to a' 
minimum. Remember that the parser has t^lie ability to ignore words in the 
inpu"t string so we do not want to spend a lot of time correcting a word 
that won*t be needed in understa^nding the ^ statement* ' But notice that 
certain words c^ ,be critical to the correct understanding of a statement * 



(5) The spelling correction routines are provided 5y INTERLISP and were 
developed by Teitelman for use in the DWiM facility (Teitelman l969»l974). 
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For example^ suppose tha^ the phrase "the ba3e emitter current of Q3" was * 
incorrectly '^typed as ^ "the bse emitter current of Q3". If "bse" were not 
recognized as^ Jjeing ''base" the parser would Ignore It and C mis- ) uird erst and 
the phrase as "t^he emitter c urren t of Q3^^ a perfectly ac ce^ table bu,t much 
different concept*(6) Because of this problem, words like "D^se", which If^ 
i^gnared have been found to lead ^ to misunderstanding^ , are considered' 
6rltlcal and their spell ing is corrected before any parse is attempted. ' 
Words that are misspelled are not corrected until ' t^e second attempt at 
spelling .correction that is done after a statement 'fails to parse* ' 

Compound words arei- single epncepts* that appear In the surface 
structure as a fixed series of more than one word* Their reduction Is very 
important to the efficient operation of the parser* For example, in the 
question ^what is the voltage range switch setting?'*, ''voltage range 
switch** i^^ewri tten as the single item "VR", If not rewritten, "vol tage" 
would be mi St en as the beginning of>a measurement (as in "what is the 
voltage at Nil'*) and an attempt would have to be made to parse ^ range switch 
setting as*a plaije to measii^^e voltage. Of course aftg^ this' failed, the 
cprrect parse can^' still be found, but reducing compound^ word s helps to 
avoid backtrack^g* In' addition, the reduction of 'compound words " 
simplifies the grammar rules by all owing them to work^ with larger 
conceptual units. In this sense, the preprocessing can be viewed as a 
prelim In ary bottom- up parse that recognizes local, multi-word concepts. 

IMPLEMENTATION ^ / ^ 

Once the dependencies between semantic concepts have been expressed In^ 
ti\e BNF form, each-^rule in the grammar Is encoded (by hand) as a procedure 
.l.n t^*® programm ing language LISP* This encod ing process Imparts to the 
grammar a top-down control structure, specifies the order of a^Splicatlon of 
the various alternatives of each rule, and defines the process of pattern 
matching each rule* The resul ting^ collection of LISP f unc tions constitutes 
a -goal-oriented parser in a fashion similar to SHRDIW (Wlnograd 1 973), but 
wi*thout the backtracking ability of PROGRAMMER* 

^ ^ ' ' L 

( 5 ) To minimize the cons^'quences of such misin terpre tat Ion , the system 
always responds with an answer that Indicates what question it Is 
answering, ra^ther than just giving the numeric , answer* 
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As has been argue^d elsewhere (Woods 1 970; Wi^o^rad 1 973), encoding the 
grammars as procedures including the notiQn <?f process in the grammar 
has advantages ' over using traditional phrase structure grammar 
repr^se^ritifiLtidns , Four afthese^dvantages^re: 

^y the ability to collapse common parts of a grammar rule white still 
maintaining the perspicuity of the jgramm^ar. - r 

2) the ability to collapse similar rules by pa33ing arguments (afs<' with 
SEHDR) . . ^ , . > ^ ■ . 



3) the ease of interfacing other types -of knowledge (in ' SOPHIE,' 
''the semantic network) Into -the parsing proce^ss^ . * , 



primarily 

J 



the parsing 



^) the ability to build and save arbitrary structures during 

process* (This ability is some^^imes provided by allowing augments on 
phrasestructurerules.) 



1^ » ad^dition to the advantages it .shares with oth^r procedural 
representations, the LISP encoding has the compu^tatipnal advantage' of being 
compilable directly into efficient machine code.. The LIS? implementation 
lyS efficient becadse the notion ot^rocess it contains (one process doing 
recursive descent) is close to that supportel^ by physixial machines, while 
those of ATH and PROGRAMMER are non-deterministic and, hence not directly 
translatable into present - architecture. See (3jurton 1976 ) ,f or a 
description of hoW it is possible to minimize this mismatch. ) 

In terms ^f efficiency., the LISP implementation " of the semantic 
gramma rp succeeds admirably. The grammar written in - the INTERLISP dialect 
of L^SP (Teitelman 197^) can be block compiled. Usi^hg thls^ technique, the' 
complete parser takes about 5K of storage and parses a typical- student 
statement can-sisting of 9 to 12 words in around 15^0 milliseconds! \ 




V 
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A NEW-FORMALISM -- SEMANTIC AUGMENTED TRANSITION NETWORKS 

** 

Using /the techniques described , in .Section 3v,^ a natural language 
processor, capable of supporting the dialogue pres^nted^ in Section 2, and 
requiring less than 200 milliseconds cpu tim^ /per q^uestion, was 
co'nstructed*^ ^n addition, \hese same techniques were used to build a 
processor for NLS-SCHOLAR (Grignetti et al, 197^1; Grignetti et al. 1 975) 
(buil t by Larkin) , and an interface to an experimental laboratory for 

exploring mathematics using attribute blocks (Brown and Burton 1978)* la 
the co^ns tru c t iori of these vai^ying systems, the notion of s em antic grammar 
proved to be useful. The LISP implementation, however, was found to be a 
bit unwieldy* While expressing the graminar as programs has *benef its in the 
area of efficiency and allows complete freedom to explore new extensions, 
the technique is lacking in perspicuity. This lack of perspicuity has 
three major Vdrawbacks: (1) the difficulty encountered when trying to 
modify or extend the grammar; (2) the prQbleifi of -trying to communicate the 
extent of the grammar to either a usei^t^r a colleag'fie; (3) the pVoblem of 
trying to re-impleduent the^^rammar on a mac^^ne that does not support LISP. 
These difficulties have been partially overcome by using a se<^ond , parallel 
repres entat ion of the ^r'^™™^'' iri ^ BNF-like specification language which is 
the irepresentation ■ w^ ynave been presenting t^oughout this report. This, 
how ever, requires suppcfr* ting two d if f-ere n t repr^entations of the same 



information ' and does not really solve problems' (l) or (3) . The solution 
to this problem is. a i(be*tter formalism for expressing and t)iinking about 
s'^jnantic grammars , - ' ^ 



AtlGMENTED TRANSITION tTETWORKS LATtil . ^ 

Some years ago t\ Chomsky ( 1 957 ) introduced the notion tha\ the 
processes of language generation and language recognition, could be viewed 
in "terms of>* a machine* ^One of thesimplest of such mo dels is the finite 
state machine* It starts off in its initial state looking at the first 
symbol^, or word, of its inTput sentence arid then moved from state to state 
as^ it gobbles up the remaining input symbols* The sentence'i^ ^qpepted . if 

one of its 'final states after having processed the 

A conve nient way 



in 



the machine stops 
entire input string; ottierwise ^he sent.ence *is fe leoted 
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of representing a finite state machine as a transition graph, in which 
the states correspond to, the nodes of the'graph and the transitions between 
states correspond ^to its arcs . Each arc is labelled with a symbol whose 
appearance in the input can cause the given trains it ion . 

In an augmented trans it ion ne'twprk , ^ the notion of a trans it ion graph 
has been mod i Vied in three way s: (1) the addition of a recu rs ion mechani sm - 
that allows the labels on the arcs ' to be non-terminal ^symbols that 
cor re s pond to network s ; (2) the addition of arbitrary ' cond itions on the 
arcs that must be satisf ieii *in order for an arc. to be followed; (3). the 
inclusion of a set of structure building actions on t^e arcs, together with 
a set of natures registers for holding partially built structures. (This 

T 

discussion follows closely a similafr discussion in jrfoods (1970) to which 
the*reader is^ referred * If the reader is familiar with' the' ATN formalism 
he/she may wis^ to skip to the section "Advantages to" the ATN Formalism*' * ) 
Figure ^,.1 is a' specif ication* of a language for ' representing augmented 
transitioV^Sietworks * The s pec i^f ica tion Is given i^n the form ^ of an 
extended t context-free grammar in which alternative ways of forming a 
(constituent* are represented *on separate lines and the symbol " + " is used to 
indicate arbitrarily repeatable constituents* ( is used to mean 0 or 
more occurrences* While the a cce pted u sage of Jl^t^'r^-^^^s 1 or more » the 
a'icrcept'ed symboi^ Jfor 0 or more, has not 1)een used>(to avoid confusion 

^with the use of th^' symbol * in the ATN formalism. ) '"The ncjn-terminal 
symbol-s are lover ^ case English descriptions enclosed in aXgle brackets* 
ftl otj^er -^ymbolst except " + are terminals* Non-terminals not given in 
Figure 4^* 1 have names that should be self-explanatory. 
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Figure 4 /-I ' 
A Language for Representing ATMs 

<transition network> : C<aro set> <arc set> + ) 
<arcset>t^(<state><arc>+} 

<arc> := (CAT <category naine> <test> <action^+ <teriii act>) 
(WRD <wordr <test> <action>^ <teriii a(?t>) " ^ 

(PUSH <state> <test> <action>+ <teriii act>)- . 
vTST <arbitrary label> <test> <action>+ <term act>) 
(pop <rorm> <tSst>) 

(ViR <ccxnstituent naine> <test> <acttion>+ <teriii act>) 
(JUMP <3tate> <test> <action>+) ^ i 
<action> := (SETR <re'gister> <foriii>) 

(SEHDR <register><foriii>) / ; 

(LIFTR <register> <foriii>) ^ 
(HOLD <constituent naiiie> <foriii>) 
(SETF <feature> <forffl>) 
<teriii act> ;= (TO <state>) 
< foriii> 



: (GEJR <register>) 



;GETF <forffl> <feature>) ^ ^ " 

,BUILDQ <fragment> <register>+) , ■ , 

LIST <forn)>+) ^ , 

APPEND <forni> <forffl>) ' 

QUOTE <arbitrarjr structure>) ^f 
The first eletffent ^ of each arc is a word indicating the type of arc. 
For arcs of type CAT, JWRD and PUSH, the- arc *type together with the secolid 
element^ c or r espon^ to the label on an arc of ,*a state transition graph. 
The third eleraent^is an additional test. A CAT (category) .arc can be. 
followed* if the current input symbol Ts a member of the lexical category 
named on the arc\ and if the test on the arc is satisfied. A PUSH (network 
call) arc causes a recur^sive invocation of a lower level network beginning 
at the state indicated, if the test is satisfie<l. Thet VJRD (word) a*rc can 
be followed if the current input symbol is the word named on the arc and if 
the test is sa'^sfied. The TST (test) arc can be followed if t'he test is 
satisfied (the label is ' ignored 1^. ■ The VIR arc (virtual arc) can be 
followe^d if" a constituent of the named type^Jxa-s^4xaan~_pl a ced *on ^ the^ hold 
list by a previous ^OLD action anci the constituent satisfies, the test* In 
alX of these arcs, the^actions are structure" building actions, and the 
terminal act?ion /4pec i f iVg the state to which control is^ passed as a re^sult 
of' tihe transition. After OAT, WRD and TST arcs, the input is advanced; 
after VIR and PUSH arcs it is not. The JUMP arc can be followed whenever 
its test is satisfied, control being passed to the state speci^fie^ *in^ the 
second element of the arc without advand^^ng the input. The POP (return 
from network) arc ind ica tes the conditions under which the state is to be 
consider ed a final state and the form of the constituent to be. returned. 



Th^' actions, forms and tests on an arc may be arbitrary functions^ of 
the re^gister contents- Figure 4*1 presents a useful set that illustrates 
major^ fea^fcures of the ATN- The first three actions specified*in Figure 4.1 
cause the contents of the indicated register to be set to the value of the 
indicated form- SETR (set register) causes this to be done at the current 
level of cQjuputatiort, SENDR( (send, register) at the next lower level' of 
embedding,^ so that Information can be sent down during a PUSH, and LIFTR 
(lift reg^is ter ) at th$ next higher level of computation, so '"that additional 



in formation can 



be ^ returned 



to higher levels- The HOLD action graces a' 



form on the tfOLD list to be us ed* at a later place in t^e computation by a 
VIR arc\ SETF (set feature) provides a means of setting a ffpatu-r^ of the 
constituent be ing built- ^ \ 

GETR (get register value) ^is a function whose' value is the contents of 

-th^ named register- LEX (lexical item) 'is a* form whose value is the 
current input symbol- The asterisk (*) is a form whose value depends on 
the context* of* its use: (-1) in the ac,tions of a CAT arc, the value of *'is 
the root form of the current input word; (2) in the actions of a PUSH 

,arc*, it is , the value of the lower computation; and (3) in the actions 
fd'liowing a^VIR arc, the -value of^it is the constituent' removed, from the 
HOLD list. ' GETF^. i&- a function which determines^the value of a specified 
feature of the indicated form Xwbi^h is usually *)- BUILDQ is a g^eneral 
structure- building form ' that places'^'^he values of the given regist^^r^ into 
a. specified tree fragment. Specifically,* it replaces each occurrence of + 
in^ the tree fragment with the ^ntents of orhe of the registers (the first 

.register replacing the first occurrence of +, the secSnd register the 

Second, etc,)- In addition, BUILDQ replaces occurrences of * by the value 
of the fprm *- The remaining three forms make a list out of the specified 
arguments (LIST),- append two 1 i s ts; togf th e r to make a single list (APPEND) 
and produce as a value the ( un evaluated ) argument form (QUOTE) . 

OP ATH FORMALISM 

The ATN formalism was seriously considered at the. beginning of the 
SOPHIE project, bujt reijected as being too slow,' 'iji the course of 
developing the LISP grammrar,' it became clear that the primary reason for a 
significant difference *in speed between an ATN grammar and a LISP grammar 
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lar 



is due to the fjact that processing tlie ATM is ^ interpreted process, 
whereas LISP is compilable and therefore^ thye time problem could be overcome 
by building an 'ATN compiler. During the period, of evolution of SOPH?E's 
grammar , an ATN compiler was constructed (see Burton 1976). In the next 
section we will discuss^ the advantages we hopedf ,to gain by using the ATN 
f ormal i sm * ^ - \ - 

These advantages fall inter three general aif*easr (l) conciseness, (2) 
cpnceptual effectiveness and (?) available facilities. By conciseness, we 
mean that writing a grammar as an ATN takes le5s, characters than LISP* 
The ATN formalism gains conciseness by not requi-ring the spjec if Icat ion ^ 
details in the par..a^g process at the same level rejguired in LISP. Most of 
these differences stem *fro^ the f^ct that the ATN assum^es it has a- machine 
whose operations are designed for parsing, whi le LISP ^s sume s it has a 
lambda calculus machine. . For example, a ^^■i'^^^ calculus machine asauiPe'S a 
function ha^ one value. A function call to look for an occurrence at a 
non^- terminal whl'le parsing (in ATN formalism, a PUSH) must return at least 
two values: the structure of the constituent found, and the place in the 
input wh^re the parsing stoppj^^ A good deal of complexity is added to the 
LISP rules ,in order ' to mai?Trtaiii the free var-iable which has to be 
introduced to re turn the structure of the constituent. Other ex am pies of 
unnecessary details inc 1 ude the 'binding of local variables and the 
specification of contro*l structure as ANDs, and ORs* 

The conciseness of t^he ATl^ results in a grammar, that is easier to 
change, easier to -write and debug, easier to under {^f and , and IT^nc e to 
^ commjan icat e * We realize that concisene^s does not necessarily leacl to 
these results (A PL being a ^r ime example in computer language s , mathematics 
in general being anotlier), however, this, is not a problem. The 
corresponden^cje^ l^etween , the. , grammar rfiles in LISP and ATN is very qlose* 
The concepts which were ffxpr^ssed' a3 LISP code can'be expressed in nearly 
the same way as ATNs 6ut In f ewer^ symbols < 

The second area of improvemelit deals with conceptual effectiveness. 
Loosely defined, conceptual effectiveness is the degree to which a language, 
encourages one to think about problems in the right way* One example of 
conceptual effectiveness c'an be seen by considering the implementation of 
case structured rules. (See -Bruce (1975) fox a discussion of case 

V ^ 29 - ^ 



.sys tem3* ) In a typical case— structure rule , the^ verb expresses the 
function, (or relation nanui) and the subject, w^ile the obJ^,ct ^ and 
prepositional phrases express the arguments of the -function or relation* 
Let us assume for the purpose of this discussion thit- .we are Loc^kin^g at- 
four different cases (agent, location, rieans, and time) of the verb UO 
John' went to the store by, car at 10 o'clock^ In a phrase ^ .structure 
rule-oriented formalism one would b^ "encouraged to write^ * - 



<statement> 



i^e 



<actor> <actioiv/verb> <loc^tion> <me^^3>- <time> 



oin the last three cases* can appear in any order, one must also 5/rite 5 
other rules : ■ * , 



< s t ateiDen t > 



<actor> <action/ver-b> <location>, <time> <mean^> 



In an ATN one is inclined ^toward^ 



^PUSH foqdion 





PUSK time 




POP 



PUSH m$ons 



one 



to 



y 

whieh expresses more clearly the <^'ase structure'of the iy*l^* .There i%* no. 

reason why in the LISP version of the grammar one coufdn't w^itX loops that 

are exac tl y analogous to the ATN v( the AJN compiler , after aMJt, produces 

such code!)^ However, a rule-oriented formalisre does not"^ encourj 

think this way. An alternative rule implementation is: 

* < ac t ion> : - ^ac torXac t'ion /v*er b> <action1> * 
<action1>;= < ac t ion 1 X temporal > 
<ac tioni > : r < ac t ion 1 X locaktjLon> 
<ac tion 1 > : =*<act ion 1> 4jneans> 

this is easier 
1 e f t-r ecucs ive * 



(shorter) * to 
To implement 



write but it -has tfie disadya 
it , one is forced 




equivalent of the ATN that ^reates a 
representation and the actual implementation^ 
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to t write 
difference/ ^between 



T^is*."^ method 



ge of beirig 
the 'Lisp 
the^ rule 
^Iso has the*^ 



disadvantage of introd^ucing^the non-terminal <^ction 1> into the grammar. 

other conceptual adjf-an-tage of the ATN framework -is that it 
encourages the postponing of decisions ^about a sentence untile a 
differential point is reached; thereby allowing ^ftTt en t ially different paths 
to stay together. In the rale oriented SOPHIE prammar there are top level' 
rules ■ for" <set>, a cgmm&nd to change one of the control setting3<f and 

Sen t^nce 1 ) is a 



<modify>,a command to fault the instrument in-* so me way 
<set> and s-entence (2) is a <modify>: 

(1^ Suppose the current control is high. 
(2) Suppose the current control is shorted. 



The two p-arse paths for these sentences should be the satne tovf the ^^irst 
five word^s, but they are separated immediately by: 'the rules <set> and 
<modify>j. An ATN encourages structuring the gr amm ar 30 that 'Sfhe decision 
between <set> and <modify> is ^postponed so that the paths remain together. 
It coultf be argued that the fact that this example occurred- in SOPHIE's 
grammar is ^a complaint against top-do wn ' par si ng or^ semantic grammars, or 
Ju^t our particular instantiation of a semantic grammar. We suspect the' 
latter but argue that rtile representations encourage this type of behavior. 

■16' "^.Another conceptual aid'' provided by ATIJs is their method^of ^^ndl ing 
ambiguity* Our LISP implementation uses a ^ recurs i^Te desceifift^ technique 
(which can alternatively be '^iewexlxas allowing only one process). This 
requires 'theit any decision between two ^hoices be made correctly because 
tlTSre is' no way to try out the other chdice ^ f t the decision* is made"* At 
choice poiQts, a rule ^can,.of cour.se, "loo^k aheratl" and gain information on 
which to" base the decision^ similar to t1ie.^.]'wa'i^tj^-Tand-see" strategy used by 
Marcus Cl 975) but there i^'no way; to back Jap and r^^ke a decision or?£e it 
has returned , ^ ^ ' . ^ 

The effects of this can be most easily seen by considering the lexical 
aspects of the parsing. A prepass collapses compound words,' expands 
abbreviations, fete. This allows the grammar tfo be-rmuch simpler because it 
can look for units like " vol tage/ con tr ol '* instead of havin^g to decode the 

noun^phrase "voltfl^^e control". Unfortunately without the .ability to handle 
ambiguity , thi.s rewriting can only be done on words that have no other 

possible'meaning. So, for, example, wjien the grammar is extended to haridle: 
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* ( 3 y Does the voltage control the current limiting section? 

th\ compound **voltage/control" would have to be removed from the prepass 
rules' -and includ-ed in the grammar. This reduces the amount of bottom-up 
processilig that can IVg done and results in a slower parse. It also makes 
compound rules difficult- to write because all possible' uses of the 
individual w(y^d s mus't be considered to avoid errors. Another example is 

. the use of the letter **'C" as an abb r evia tio^n . Depending on context, it 
could possibly mean either current, collector or capacitor. Without 
allowing ambiguity in the inj)ut^ 'it, <teould not be allowed as an 
abbreviation unless- ex plicitly recognized by the grammar . 

The third general area in which ATMs have an advantage i^ in the 
available facilities to deal with complex linguistic phenomena. While^ our 
grammar has not yet expanded to the point of requiring any ' of the 
facilities,- T:he availability of such facilities eannot be ignored as an 
argument favoring one approach over another. A primary exarap]^e is the 

'general mecha^nism *for jdealing with coordination in English de^scribed in, 
Wood^s ( f973a) - ^ 

CONVERSION TO SEMAHTIC ATN . 

r 

For the reasolfis discussejj above, the SOPHIE semantic ' grammar was 
re-written in the ATN formalism. We wish- to stress here that thfe 
re-writing was a process of changing form only. The content of the grammar 
reniained the same. Sinc^ a large part of the kn owl edge encoded by the 

■r 

grammar continues to be seman ti c in nature* we call the reaulting grammar a 
"semantic ATN". r 

Fig ure J|.2 presents the graphic ATN representation ot semantic grammar 
non-terminal ^^hich rrtognizes the straightforward way* of expressing a^^ 
terminal of a part in the circuit the base of/QS^ the anode of it, the 
collector. Jt also shows a simple exampl/e of how fhe reoogifi t ian of 
anaphorfc deletions can be captured in ATN formal ism. By ^fe state 
TERMINAL/TYPE, both thrf determiner, and the terminal type blRe» anode 
have been found . The first arc -that leaves TERMINAL/TYPjp accepts the 
preposition tfiat * begins the specification of the part. The second arc 
(JUMP arc) corresponds to hypothesizing that the specification of the part- 



has been cleletecl, as in: "The bas^ is open*"^** The action on the^^-^Vci builds 
a VlsiG^-holding form which identifies the deletion ,and spec^if^^^ (from 
information associated with the_, terminal type which was found) the classes 
ofobje^ts that can fill the deletion. The met hod for determinin'g the 
referent of the deletion remains the same as described Section^ 3* 

Figure i*v2 

A semantic ATN which recognizesdeletion 



^^ttRWj>^ ^^Oei^PRg^ ^^S^S^PARTy 




TERMIf/Al AP^^ 
END ^ ^ 



The, SOPHI'E semantic ATN is compiled using the general ATN compiling 
system described in Burton tl976)* The "SOPfilE grammar provides the 
compilinj^ system with^ good contrast to the L*UNAR grammar, since it does 
not use^many of the potential features* In "^addition, a bench mark, qf 



a bench 

sorts, was available from the LISP implementation of the grammar that could 



be Used to determine the comput^ational cost of using the ATN formalism. 

. . W . . , * 

There were two modifications made to^he cora^piling system to improve 

its efficiencV for the SOPHIE application. In the SOPME grammar, a large 

Aumb'er , of the arcs" check for the occur rre nee - of particular words* When 



there is more than one arc leavi^ng a state , the 
that air of these arcs be tried, e.v^n if more tha 



4TN forma 
lan^wie of 



formalism requires 
these is a WRD 

arc and an earlier WRD arc has succeeded. This is espec ial ly -cos t ly , since 
the taking of an aj^c requires the creation, of a jsonf iguration -to try the^ 
r^emaining arcs. , In. those, cases w|ien *it'i3' known that tfoneof the* other 



arcaT can succeed, this should be avoided 



As a solution to this ^ problem, 



the GROUP arc type was add^d. The GROUP arc allows a set of contigyous 
arcs to be designated as iautually exclusive* The form of the GROUP arc is: 



(GROUP arc1 arc2 



. aj;<>n). 'The^ arcs are tried,^^ one at a ' tinTSr ^/S^int i 1 the" 
oond i t ions on one 'of the aro^are^met. This arc ^fe then tjai^n , ^-^d the 
remaining aro^s in the GROtJP are forgotten not tried.' ^^.^ PUSH ^ro is 
included in the GROU P, it will be taken if its te^t is true and the^ 
remaining arcs will not Se t ried^ even if the PU^Ke d for constituent is not 
found. For -example, consider the fol lowing, gramma r s t a t e : 



(S/1 



(GROU? 



CAT A T (rft '3/2 
WRD X T (TO 3/ 
CAT B T (TO 3/ 



111 



At most, one of the three arcs will be followed. ^Without GROUPlng them 
together^ it is possible ^that aVI three might be fol>l>wed if the word X 
had inte'#ff>rtJ^tJ^tions as both ^ cat ego'ry A and category B. 

The, GROUP arc also provides an efficient means of encoding **op t iona 1 
constituents; Tbe normal method of allowing o-p'tions in AtN is to provide 
aji arc that accepts the optional constituent and a seconc^arc that jumps to 

the n ex testate without accepting anything. For example^ in state s/2 

' ' * . ■* 

the word "very" is optional^ 'the following two^ arcs would be created:- 

'^^^IwRD VERY T (TO RE3T-0 F-3/'J5 ) * " - ' • . . 

(JUMP RE3T-0F-3/2 T)) . 

The inefficiency arises when the word "v'ery" does occur. The first^arc^is 
taken\ but an alternative configuration that will try the s^econd arc m^ust 
be crea-ted, and possibly, later explored. .By embedd ing bfiese arcs in a 
GROUP|, tlie alternative will ^not be created thus saving time and s^ace* ^ As 
a V^^sult, ^ it ' won't have to ■ be explored^ possibly saving more t'ime- A 
i^arni-ng should be included here., that the GROUP arc. *can reject sentences 
■that might otherwise ^e accepted. . In our exampl^e, '*very" may be needed to 
get out. of the state REST-OF-S/2. In this^ respect, the GROUP arc is a 
departure from the original ATM t phi losajfthy that arcs should be indep^endent^ 
and foV* thi'^. we apologize. Howevjj?^ fo 
^efficiency can be. critical. ^ 



for some applications , the increased 



^^^^ 
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The otlver change to the compiling system (for the semantic grammar 
application) ^dealt with the prepi^oce s s ing operations; The preprocessing 
facilities described in the last section-included : 1) lexical analysis to 
extract word endings; 2) ,a substitution' mechanism to, expand abbreviations; 
delete noise wtfrds, and, canonical i,ze synonyms; 3) dictionary retrieval 
routines; and 4)^a compound word mechanism to collapse multi-word phrases* 
Fo r the SOPHIE application we added the ability to use the INTERLISP 
spelling correction routines and the ability to*derive word definitions 
from SOPHIE 's ^ semantic net * .The ext rac t ion of def ini t ion-a from the 
semantic network for part names, and node namj^ re deuces the size of the 
dictionary and simplifies the operations of changing circuits* In 
addition, a mechanism tsall^d^ MULTIPLES was dev^oped that permits strfng 
substitution v>ith in the input* This is similar to the notion of 
compounding, '^but differs in that a compound rule creates an*^alternative 
lexical Mtem while the mul t iple rule creates a different 1 ex^ifltfal item* 
After ' the application of a compound rule, there is an additional edge in 
the input chart; after a multiple rule, the effectis the game as if^ the 
uper had tiped in a d if fe rent. string* 

FtlZZINESS - ' .^ 

The one aspect of the LISP impl ementatiom. that has not been 

incorporated into the ATN framework is fuzzine'ss, the ability to igivpre 

words in the input * While we have not Worked out t\\e detail f\ the 

non-determinism^ provided by ATNs lends itself t| an interesting approach. 

In a one-pfoce ss recursive descent imp 1 emen ta^ion , the rule that 

checks for a word must decide (with information passed down from higher 

rule^ whether to try skipping a, word, or give up* The critical 

information that is, not available when th-is decision has to be made is 

whether . or not the^e is another parse; that would use ttfat word* In the 
» * 

ATN,' it is possible to suspend a parse and come back to it after all other 
paths have been tried* Fuzzine_ss could be implemented so that rather than 
skip a word and continue, it can skip a word and suspend, waiting for the 
other parses to fail or suspend* The end effect may well be. that sentelices 
are allied to get fus,^ier because there is no danger of missing^ the 
correct parde . * * . 





COMPARISON OF RESOLTS 

The original motivation for changing to the ATN iras Its perspicuity. 
As Wlnograd (1973) has pointed out, simple 'grammars are perspicuous In 
almost any formalism; complex g>ammars are/stlll complex In any formalism. 
We fpund the ATN formalism much easler^^ to think in, write In, and debug. 
The examples ofi*^edundant proc.esslng that were presented earlier In this 
section were discovered while converting to ATN* For a gross compaErlson on 
conciseness^ the ATN grammar requires 70$ less cliaracters to express than 
the LISP version, ^ ^ ^ 

The ^efficiency results were surprising . Table , 1 gUjit^s compar l^< 
t*imings between the LISP version and tAie ATN CK;jOTt)lled version* As can 
seen, the ATN version takes less than twloe as- much time. This was 
pleasantly counter- Intu It Ive ^ as *we expec ted ' th e^ LISP version to be much 
faster due to the amount of hand optimization that had been done while 
encod Ing the grammar rules. In presenting the comparison timing. It should 
be mentioned that there are three differences between the two systems that 
tended to favor the ATN ver^on. (The exact extent to wh-ich each ^of these 
differences contributed Is difficult to gather statistics on due to the 
block compiler which galnsefflclency by h Id Ing internal workings. The 
^exact contribution "of each could certainXy .be determined but was not deemed 
worth the effort.) One difference was the lack of fuzzlness In the ATN 
Version. The L IS P^ version spent time testing words other than the current 
word , looking ahead to see if It were po&slble ^-to skip this word , whlcft was 
not done In the. ATN Version. The second Is the creation of .categorlesS^fr^ 
words during the preprocessing In the ATN version that reduced the amount 
of tlmJ spent accessing* the semantic net and hence reduced the tlm§ 
required to perform a category member ship test In the ATN system. The 
third was the simplification of the grammar and increase In the apount of 
bot;tom-up processing that could be done because of the ambiguity allowed In 
the Input chart. In our estimation, the lack of fuzzlness Is the only 
dlfferencethat may have had a significant effect, and this can b^ included 
explicitly In the ATN in placea where It Is critical, by using TST^arcs and 
suspend actions, without a noticeable*, increase In processing time. In 
conclusion, we are very pleased With the results 'of the c'omp lied s eman t Ic 



ATK and feel that the ATN compilerT»akes the ATN formalism computationally 

efficient enough to be used in real systems. 

\- 

TableU.l 

Comparison of ATN vs l*ISP Implemjentation 

Times (in seconds) ar*e "prepass" + "parsing" 
' ■ • "* ■ ' 
1) What is the output voltage? 



LISP - )A2^ + .018 = ,gll2 

ATI^- ^8 + .033 - .081 \ 

2) What is the voltage between there' and the base, of q6? 

LISP - .038 + .02^9 = .077 
ATN - .09t5 + .M = . 1 36 

3) Q5? . , - 

' LISP - .010 + .01(6 = .056 / 
ATN - .013 + .060 r .673. ^ 

^) Vfhat is the oujtput voltage when the voltage control is set to ,5? 

LISP - .015 + .038 « .083 * ' 

-ATN - .096 + .048 s .UU 

5) If Q6 has an- open emitter and-a shorted base collector Junction what 
happens to ttie voltage between its,bas^e arjd the junction of thex^outage 



limiting section and Ijie vol tags, reference (source? 

LISP - .206 + .188 s .391 
ATN - .259 + .090 = ,359 



Se^ction 5) * . . - 

When ^ began (developing .a natu^l language* proces^sor for an 
instructional environment, we knew it had to be ^1 ) fast, (2) habitable, 
and (3) sel f- te ac h ing and ^) able "to deal with , amtiiguity. The basic 
conclusion that has ?irisen from the work presented here is* that it is 
j^^'osslble to satisfy' these constraints. The notion of semantic grammar 
^(presented in Section 4) provides a paradigm for organizing the knowledge 
required in the understanding process that permits ef f iciefe't parsing. In 
addition, semantic grammar a^ids the habitability byproviding insights into 
a useful class pf dialogue construe t^s, and permits efficient handling of 
^such phenomena as pronominalizations and ellipses. The need for a better 
formalism for expressing semantic grammars led to the use of Augmented \ 
Transition Hetwbrks (presented in' Section 4)., ' The ability* of the 
ATH-expressed semantic gr'ammar to satisfy the above stated requirements is 
demonsVe^^t^d in the natural language *fnont-end Cor the SOPHIE syst^em* 

A point thai needs to ^^e stressed Is that the SOPHIE system has been* 
(ajid is b^ng ) u«ed by unln i t iat ed students in experiments to determine* the 
pedagog ical effectiveness of its environments. While much has been 1 e^^^ned 
about the ^problems of using a ^natural language inter fa ce, ^hese eicper^ments - 
were not " debugg ingv" sessions ^"^r the natOral language component. The 
natural language component has unqqe st ionabl^l^^-eac hed a state at Which it 
can be conveniently *used to f ac il ita^iKe>, 1 ear,n,irfg about electronics. In this 
section, we will describe the experiences ofstudents using the natural 

languag'e component, and present some ideas on handling erroneous inputs* 

c 

IMPRESSIQMS. EypERlEWCES AWD^ ORSRRVATIONS \ 

As mentioned in the introduction,* students are 'very uns(tilled, at 
paraphrasing their thoughts, This same inability to perform linguistic 
-paraphrase cai*ried over -to the actual' interaction with SOPHIE via 
, terminal\ Whe^jever the system did not accept a query, there was a marked 
delay before' the student tried again. Sometimes the student *would abandon 
^ his' line of questioning completely. At the same time, data collected oyer 
flman7 sessions ' indicated that there was nonstandard canonical way to 

Table- 5. 1 provides some examples of thQ range^ of 



phrase a qii>e,stion, Table^5.1 provides some examples of 
phrasings usVd by students to ask for the voltage at a node. 
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Table 5*1 
Sample Student Inputs 



students with the intent 



The following are some of th^ input, lines typed by s 
of discovering th€ voltage at a pode in the circuits 

What is the voltage at node 1? \ 
What is the voltage at the base of*Q9\? 

'How .much voltage at HIO? . * ^ 

And what is the voltage at HI? ^ ^ ^ 
H9? ^ , 

V at the neg *siae of C6? 
vn is? 

What is the voltage from the base of transistor Q5 to ground? 

What V at N16? 

Coll. of Q5? 

Node 16 Voltage? 

What is the voltage at pin 1? 

Output? * . , - 

As ^Table 5^1 shows, students are likely to conceive of their questions in 
^many ways and to express each of these conceptions ' in an^ of several 
phrasipgs • Yet' other experiences indicate that they lack the ability to 
easily convert to another con<iep tualiza tion or phrasing* Since the 
non-acceptance of 4jUjg,stions creates a major interruption in*the student* s 
thought process^^ the ^^a^^^tance of many different paraphrases is critical 
to' maintaining f*low in the stu^ient^s problem solving* 

< Another ' ijtteresting phenomenon that occurred during ses3ions was the 
^Qhange in the linguistic behavior of the students as they used the system. 
Initially, queries were stated as complete English questions , generally 
stated in templates created by the students from the writtep examples of 
sessions that we had given, them. If they needed to ask some tfi ng that did 
not exactly fit one of their templates| they would try a minor variant. A9 
they became more familiar with the mode of interaction, they began to use 
abbreviations,, to. leave out parts of 'their questions and, in ge,neral, to 
assume that th'^e system jtas following thetr interaction* After five hours 
of e5fperience with the * system | almost all of , one student' s queijies 
contained abbreviati9ns and one. in six depended on the^ontext established 
by previous statements* ^^^^^ . :> 

FEEDBACK - WHEH THE GRAMMAR FAILS . ' ^ 

r 

From our experiences with students using^ SOPHIE , we h ave been 
impressed with the importance of providing fefedback to unacceptable^ inputs 
what to do when the system doesn't understand an inputs While it may 
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app'ear that in a comiMetely habitable systeih all inputs would be 
understood, no sys^tem has ever ' attained this goal and none will iii the 

foreseeable future. To be natural to a naive user, an intelligent system 

should^ act^ intelligently when it fails too. The first step tQwards having 

a system fail intelligently is the identification^ of possible areas of 

error* ^ In student's use of the SOPHIE system, we have found the^ following 
types of errors to be, common: 



Q3 and opwn its 



(1) Spelling errors and mis-typings ^ "Shortt the CE og 
^base"; ''What is the vbe Q5?'* ^ 

(2) Lhadvertent omissions - **What is the BE of Q5?** (The user left out the 
quantity to measure. Note that in other contexts this is a well formed 
ques t ion , ) 

(3^) Slight misconceptions that are predictable - **What is the output of 
transistor (The output of a transistor* is not defined): "What 

is ^the current thru node 1?** (Jflodes are places where voltage ^ is 
measured and may hay,6. numerous wires associated with them) ; '♦Wnat is 
(R9 is a resistor ) ; »»Is Q5 conducting?^ (The -laboratory section 
of SOPHIE gives information that is directly* available from a real lab 
■ such as currents and voltages , ) ^ a 

(4) Gross misconceptions whose underlying meaning is well beyond designed 
system capabilities - '^Make the output voltage 30 volts**: **Turn on the 
poweV supply and tell me how the unit functions**; **What time is it?,*** 

The best technique for dealing with each type of error is an open problem* 

In the remainder of this section, we will discuss the solutions used in tlje 

SOPHIE syst^ to p ro videjleedbac k * 

The use of a spelling correction algorithm ( barrowed^ f rom INTERLI^SP) 

has proven to be a satis factory solution to typo s and misspellings. 

During one student 's session, s pel ling correction was required on, and 

resul ted in proper understanding of, 10$ of the questions* The major 

failings of the" I NTERLISP^ algo r i thm are the restriction on the size of the 

% 

target set of corr^ect words (time increases linearly with the number of. 
words) and its failure to co1h:'ect run-on words* (The time required to 
determine if a word may be two (possibly misspelled) ""words run together 
increases very quickly ^ith the length of the word and the number of 
po s sibly CO rre<^t words* With no context to re strict the possible list of 
words,- the computation involved is prohibitive*^) A potential solution to 
both * shortcomings would be to use the context of the parser to reduce the 
possibilities when^it reaches the unknown word. Because of the* natur*e of 
the grammar » this woiffH ^lloV semantic context as well as syntactic context 
to be used% ^ ' * . * 
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Of course I the use of any spelling correction procedure has some 
dangers, A word that Is spelled correctly but that the system^ doesn*t know 
may be changed through spelling correction to a word the system does know* 
For example If the system doesn*t know the word ^'top** but does know **stop**i 
a user * s command to "top everythj^ng** can be disastrously misunderstood. 
For this reason, words like *'stop*' are ^not spelling corrected. 

Our solution to pred let able misconceptions is to recognize^ them and 
give error messages that are directed at correcting the misconception* We 
are currently using- two different methods of recognition. One Is ,to loosen 
up the grammar so \ that It' accepts plausible but meaningless sentences. 
This technique provides the procedural specialists called by the plausible 
parse en^gjagh bontext to make relevant comments . For example , the concept 
of current through a node Is accepted by the grammar even though It Is 
meaningless. The specialist that performs measurements must then .check It? 
arguments and provl de f^eedback If necessary : * 

>> WHAT IS THE CURRENT THRU NODE 4? 

The current thru a node Is not meaningful since by IClrchoff*s law 
the sum of the currents thru any node Is zero. Currents can be 
measured thru parts (e*g. CURRENT THRU C6) or terminals 
(e.g, CURRENT THRU THE COLLECTOR OF Q2 ) * 

Notice that the response to the question presents!' some examples of how to 
measure the currents along wly^e^ that lead Into the mentioned node. 
Examples of questions that will be accepted and are relevant to the 
student ^s needs are among the best possible feedback . 

The second method of recognizing common misconceptions Is to *!key** 
feedback off single words or groups of words* In the following examples, 
the **keys** are **turned on**. Notice that the response presents a 

^general characterlzation^of the viola ted limitations as well a& sugg est Ions 
for alternative lines of. attack* 

>> COULD Q1 OR Q2 BE SHORTED? \ 

I can only handle bne question, hypothesis, etc. at a time. The^fact 
that you say *0R* Indlca^tes that you may be trying to express two 
concepts In the same sentence* Maybe you can break your ' s,tatement 
into two or more simple ones . 
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>> IS THE CURRENT LIMITING TRANSTSTOR TURKED ON? 

The laboratory section of SOPHIE is designed to provide the same 
elelDentary measurements that would be available in a real lab* ^ If you 
want* to determine the state of a transistor, measure the pertinent 
^jsp— Ji^rents and voltages, 

Th e se method_s of coping* with errors havfe p ro v*6d to be 'very helpful* 
However, they require that all of the misconceptions must be predicted and 
programmed for*in advance. This limJ^tation makes them inapplicable to 
novel situatiQns. 

*The most severe problems a user has stem from omissions and major 
misconceptions errors* After a simple omission, the user may not see that* 
he has left anything out and may conclude that the system doesn' t know 
that concept or ph ras ing of that concept. For example when the user types 
"What is the BE of Q5" instead of "What is the VBE of Q5?", he may decide 
that it .is unacceptable because the system doesn't 4iallow ^VBE^ as an 
abbreviation of *^base emitter voltage" . For conceptual*, errors, the user 
may waste a lot of time and energy attempting several rephrasings of his 
query , none of which can be understood because the system doesn', t knoft tjie 
concept the user is trying to express. For example', no matter how it is 
phrased, the system won't understand "Make the output voltage 30 volts" 
becailse measurements cannot be directly change d^ only controls aj^d 
specifications of parts can be changed* 

The feedback necessary to correct both of these classes of errors must 
identify any concepts ir\ the statement ^>*4rart are understood and suggest the 
range of things that can be done to/with these concep^^s* This may help^the 
user see his omission or may suggest alternative conceptualizations that 
get at the 



alternative 

same Information (for exiample , to change the output v.oltage 



indirectly by changing one of the controls) or at least provide him with 
enough information to decide when to Quit . 



Section 6 ' 

FUSTHER RES^ABCH AREAS , , • • 

The SOPHIE semantic grammar sys^tem is designed for a particular 
context trouble shooting within a particul&r domain, namely , 

electronics* It represents theT-^ompilation of those pieces of, knowledge 
which -are general (linguistic) together with^ specific domain^ dependent 
knowledge. * Iti its present form, it is unalear which knowledge belongs to 
which area . The development of semantic grammar* s for other applications 
and extensions .^to the semantic grammar mbchandsm to include other 
understood linguistic phenomena^ will^ clarify this distinction** 4 

While the work presented in this report has dealt mostly on one area 
of application, the notion of semantic grammar a^ a method of integrating 
knowledge into the parsing process has wider applicability, "^wo 
a^ter native applications of the technique have .been completed. One deals 
with "^simple sentences in the domain of attribute blocks (Brown and Burt6n 
1978) . While the sublanguage accepted in' the attribute blocks environment 
is very simple^ it is noteworthy that within the semantic grammar paradigm, 
a simple grammar was quickly developed that greatly ^ improved the 
flexibility of the input language* The other completed application deals 
with questions about the editing system NLS (Grignetti et al. 1975)* In 
this application,* most questions dea'lt- with editing commands and their 
argtfnients , and fit .nicely into the case frame notion mentioned in Section 
4 * The case frame use of semantic grammar id be ing conside red f or , and may 
have its greatest impact on; command latiguages* Command languages are 
typically-i^tjase ceiptered around J^he command name that requires additional 
arguments (its caaes) * The combination ^of ttie semantic cla'ssif ication 
provided by the semantic grammar and the representation of case rules 
permitted by ATNs should go a long way towar(^s reducing the rigidity of 
complex command languages aAiclfa^^hose required for message processing 
systems * ^ The co^mbina t ion should al so be a good representation for natural 
^ lanffuage systems in dtomains where it is possible to develop a strong 
underlying conceptual space , such as management information systems 
^ (Malhotra J975 J* r 
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CONCLUSIONS ' * ; " 

^ In the course of thig chapter; w« have described the evolutio,n of' a 
natural language front-end^, from keyword beginnings jto a system ca-pable of 
using complex linguistic kntiwledge . The guiding strand, has^ be^ the 
ut*4^ization of semar\tic Information to ^produce efficient ^natural langiTage 
proces3ors* There were several highlights that, repres.ent noteworthy points 
in the spectrum of useful natural language systems*. Toward the keyword end 
of the scale,' the procedural encoding technique ^with fuzziness (Sect ion ^ 3)- 
allows' simple natural language input to be accepted without Introducing the 
complexity of a new formalism. Encojding the rules as procedures allowed 
flexible control.off the fuzziness and the semantic nature of t^e rules 
provides the correct places to take ^dvaata&e of the flexibility* As the 
language covered by the system becomea^more compie^x, the .additional burden 
of a grammar .formalism will more than pay for itself in terms of ease of 
development and reduction in complexity *^ The ATN compiling system allows 
for tlie consideration' of the ATN -formal i sm by reducing its runtime cost, 
making It' comparable to & direct procedural ^encodini^* The natural language 
front end now used by SOPHIE Is constructed by compiling a semantic ATff* 
As the linguistic complexity ' of the language^aGcepte4 by the system 
^increasesi the-^need for more syntactic knowledge * the grammar becomes 
greater. Unfortunately , this often' work& \t <5ross pur{)ose3^ with the 



semantic character of the grammar* It wourMjfc|a/ nlae to . haVe a geiieral 
^grammar for English -^ntax that couldtW^sed to pr^process sentejices; 
however, one Is not' forthcoming. A general *solution^ to the problem of 
' incorporating semantics with the current ^tate, oV incomplete knowledge of- 
syntax remains an open research piwblem.' In the f orf^eable f wture, any 
system win have to be an Engineering trade-^oEf between complexity and 
generality on one hand and efficiency and .habltl>(^llt^^n the other* We 
have presented several' tecliniques that are ..vl^^^e ba<rgalns In this 
trade-off. ' >r-' ^ 
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